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Abstract 

These lecture notes can be read in two ways. The first two Sections contain 
a review of the phenomenology of several physical systems with slow nonequi- 
librium dynamics. In the Conclusions we summarize the scenario for this 
temporal evolution derived from the solution to some solvable models (p spin 
and the like) that are intimately connected to the mode coupling approach 
(and similar ones) to super-cooled liquids. At the end we list a number of 
open problems of great relevance in this context. These Sections can be read 
independently of the body of the paper where we present some of the basic 
analytic techniques used to study the out of equilibrium dynamics of classical 
and quantum models with and without disorder. We start the technical part 
by briefly discussing the role played by the environment and by introducing 
and comparing its representation in the equilibrium and dynamic treatment 
of classical and quantum systems. We next explain the role played by explicit 
quenched disorder in both approaches. Later on we focus on analytical tech- 
niques; we expand on the dynamic functional methods, and the diagrammatic 
expansions and resummations used to derive macroscopic equations from the 
microscopic dynamics. We show why the macroscopic dynamic equations for 
disordered models and those resulting from self-consistent approximations to 
non-disordered ones coincide. We review some generic properties of dynamic 
systems evolving out of equilibrium like the modifications of the fluctuation- 
dissipation theorem, generic scaling forms of the correlation functions, etc. 
Finally we solve a family of mean-field models. The connection between the 
dynamic treatment and the analysis of the free-energy landscape of these mod- 
els is also presented. We use pedagogical examples all along these lectures to 
illustrate the properties and results. 
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1 Introduction 



Graduate and undergraduate courses on statistical mechanics and thermodynamics 
are usually devoted to the theory of macroscopic systems in thermal equilibrium. 
In many experimental realizations, actually some of the more interesting ones at 
present, the situation is, however, very different. The systems are in contact with 
equilibrated environments but, for one reason or another, they do not manage to 
equilibrate with them. The systems evolve in time in an out of equilibrium manner. 

The list of systems evolving out of equilibrium is very long. The reasons for 
not reaching equilibrium with the environment are also varied. The most common 
cases are those in which the time needed to equilibrate the sample falls beyond the 
experimental time-window. We discuss them in the context of domain growth, phase 
separation and classical and quantum glassy systems. Another important cause for 
lack of equilibration is the action of external forces that drive the samples out of 
equilibrium. In this context we discuss the rheological properties of glass forming 
liquids and glassy materials, that are closely related to the relaxation of the same 
systems. The driven dynamics of granular matter is another example of this kind. 
Finally, we briefly touch another type of problem that has received much attention 
in recent years: the relaxation and weakly driven dynamics of elastic manifolds 
in random potentials that model magnetic domain walls in disordered materials, 
superconductors, Wigner crystals, etc. 

A common feature among the relaxing and weakly driven examples cited above 
is that they evolve very slowly. Thus, they belong to a particular class of the full 
set of non-equilibrium systems. Exploiting the fact that their dynamics is slow, and 
other more subtle properties that we shall discuss along these notes, we can hope to 
develop a common theoretical description for all of them. 

In these lectures we focus on the study of a family of simple models that can be 
adapted to mimic the above mentioned physical systems. Typically, these models 
are fully connected interacting spin systems or models of interacting particles in 
infinite dimensions. They can be seen as the equivalent of the fully connected Ising 
model for ferromagnetism that correctly predicts the existence of a thermodynamic 
transition and the nature of the two phases but fails to describe the dependence 
on dimensionality or the precise critical behavior. Similarly, the schematic models 
do not include a notion of distance inside the system. This crude approximation 
allows one to solve the dynamics explicitly, paying the price of loosing information 
about the behavior in real space. Models of finite manifolds embedded in infinite 
dimensional spaces and under the effect of random potentials are generalizations 
of the schematic models that capture partial spatial information. They are also 
solvable analytically. Interestingly enough, one finds that these models realize sev- 
eral phenomenological approaches to glassy physics that have been known for long. 
Moreover, their dynamic macroscopic equations coincide with those arising from the 
self-consistent approximations used to analyze more realistic models as, for instance, 
the mode-coupling approach to super-cooled liquids. Having an exact solution is 
very important in many respects. Firstly, it establishes the phenomenological ap- 
proaches on firmer bases. Secondly, it allows one to set clear limits of validity of 
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the self-consistent approximations to realistic models. Thirdly, being defined by 
interacting potentials their free-energy density is accessible to analytical studies, 
from which one obtains the organization of metastable states and relates it to the 
dynamic properties. Fourthly, many important and common features of systems 
evolving slowly out of equilibrium have been discovered in the analytic solution to 
these models. Fifthly, one is able to identify some of the missing ingredients needed 
for a more accurate description of real systems. Even if their treatment has been 
too tough to implement correctly yet, it is important to know in which direction 
one could try improving the analytical study. In short, they constitute a very useful 
"laboratory" where one identifies general trends that can be later tested numerically 
and experimentally in more realistic models and real materials. 

Although the models on which we concentrate are simple in the sense discussed 
above one needs to master many analytical methods to extract all the richness of 
their behavior. These methods are not completely standard and are not comprehen- 
sibly described in textbooks or lecture notes. For this reason, we try to present a 
rather complete and detailed introduction to them. We also discuss the scenario for 
glassy dynamics that stems out of this analysis. Finally, we mention several lines for 
future work that are currently being explored by several groups trying to go beyond 
the fully-connected and infinite dimensional models. 

The lecture notes are organized as follows. In the next Section we introduce 
the phenomenology of the physical systems we are interested in paying special at- 
tention to the dynamic properties that we later describe analytically. The rest of 
the lecture notes are more technical. We start by reviewing very briefly several 
theoretical approaches to the glassy problem in Section 3. This summary is cer- 
tainly not exhaustive but it may serve as a source of references. Since in the rest 
of the notes we shall develop classical and quantum systems in parallel we devote 
Section 4 to discuss how should one model the coupling between a system and its 
environment in both cases. In Section 5 we set the notation and we define sev- 
eral useful observables for spin and particle systems. The subject of Section 6 is 
a brief discussion of Fokker-Planck and Kramers processes and how they describe 
the approach to equilibrium. In the following Section we introduce the fluctuation- 
dissipation theorem, valid for systems evolving in equilibrium. Once these generic 
properties are established it will become simpler to discuss how they are modified 
in a system that evolves far from equilibrium. In Section 8 we explain the func- 
tional formalism that allows one to derive a generic dynamic effective action and 
the dynamic equations that we present in Section 9. We also introduce the very 
useful super-symmetric formulation of classical stochastic processes. In Section 10 
we discuss an alternative method to obtain approximate dynamic equations. We 
focus on the mode-coupling (mc) approximation to show how averaging over dis- 
order in some random models eliminates the same family of diagrams that the MC 
procedure neglects for non-disordered ones. The rest of the lectures are dedicated to 
the solution to the dynamic equations of the schematic models. We present it in as 
much generality as possible in Section 11. We discuss three generic results that were 
obtained when solving these equations without assuming equilibrium: the definition 
of correlation scales (Section 11.4), the modifications of the fluctuation-dissipation 
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theorem (Section 13) and the definition of effective temperatures (Section 14). We 
also discuss how these properties appear in variations of the models that mimic the 
physical systems introduced in Section 2 and in finite d toy models, simulations and 
experiments. Finally, in Section 15 we relate the dynamic results to the organiza- 
tion of metastable states via the static and dynamic approach of Thouless, Anderson 
and Palmer (tap). We briefly discuss the connection between it and the studies of 
the potential energy landscape (Edwards measure and inherent structure approach). 
Finally, in Section 16 we summarize the scenario for the glass transition and glassy 
dynamics derived from solvable mean-field models and present some of the lines for 
future research in this area. 

2 Some physical systems out of equilibrium 

In this Section we summarize the phenomenology of a number of systems with slow 
dynamics. We especially signal the features that we expect to capture with an 
analytical approach. 

2.1 Domain growth 

Out of equilibrium relaxational dynamics occurs, for instance, when one suddenly 
quenches a system with ferromagnetic interactions from its high temperature phase 
into its low temperature phase. When the system is in contact with a thermal bath 
at temperature T > T c (T c is the Curie critical temperature) the system is disor- 
dered and the instantaneous averaged magnetization vanishes at all times. (The 
average refers here to a coarse graining over a region of linear size, £, with £ <C £ 
and £ the correlation length.) All the one-time properties, such as the instantaneous 
averaged magnetization or the static magnetic susceptibility, can be computed us- 
ing the Gibbs-Boltzmann distribution, P GB . The system evolves in time but in a 
very simple manner controlled by P GB . All properties of the equilibrium dynamics 
hold and any two-time correlation function is invariant under translations of time. 
Instead, if one externally and suddenly changes T to set it below the Curie tem- 
perature, T < T c , the system evolves from the very disordered initial condition via 
the growth of domains of up and down magnetic order. With simple arguments 
one shows that the typical linear size of the domains grows as a power of the time 
spent in the low temperature phase, lZ(t w ) = T(T)t 1 J ] z [1]. We call waiting-time, 
t w , the time spent since the entrance in the low-T phase. The dynamic exponent 
z depends on the kind of microscopic dynamics considered, e.g. for non-conserved 
order parameter z = 2 while for conserved order parameter z — 3. All T-dependence 
is concentrated in the prefactor T(T). After the initial quench the system is a su- 
perposition of up and down domains and the magnetization averaged over the full 
system (I = L) vanishes. During coarsening domains grow. This is a scaling regime 
in which the system is statistically invariant under rescaling by the typical length 
1Z(t). Typically, at a time t REQ ~ L z the system orders and the averaged magnetiza- 
tion, m, equals the magnetization of the conquering domain, say m > 0. Restricted 
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ergodicity or equilibrium within one ergodic component holds in the sense that time 
and ensemble averages can be exchanged if and only if the time average is taken 
over a time window t HEQ < t < t ERG and the ensemble average is restricted to the 
configurations with positive magnetization. Since a rare fluctuation might lead the 
system to reverse from m > to m < another, still longer, characteristic time, 
^erg, appears. This time is also a function of the size of the system L and it is such 
that for times that are much longer than it complete ergodicity is restored. One 
can estimate it to be of Arrhenius type t ERG ~ exp[cL d_1 /(fcsT)], with c a constant, 
d the dimension of space and cL d ~ l the free-energy barrier to be surmounted to go 
from one ergodic component to the other. 




Figure 1: Two snapshots of a 2d cut of a 3d lattice undergoing ferromagnetic domain 
growth with non-conserved order parameter after a quench from T — > oo to T < T c 
at time t = 0. On the left, t w = 10 3 Montecarlo steps (MCs). On the right, t w = 10 5 
MCs. Sketch of the Landau free-energy density f(m) in the low-T phase. The 
evolution of the system is partially described by the evolution of a point in this 
free-energy landscape. Just after the quench m = and coarsening is visualized in 
this plot as a static point on top of the barrier. After t REQ the point falls into the 
well around the magnetization of the conquering domain. After t EaG ergodicity is 
restored and the point jumps the barrier via thermal activation [2]. 

The low temperature phase can also be reached with an annealing, e.g. by 
modifying the external temperature in steps of length At and magnitude AT < 
until reaching the working temperature T. Since the entrance in the low-T phase the 
system coarsens. If the prefactor T(T) increases with T, after a time t w since crossing 
T c a system prepared with a slow cooling rate will have much larger structures 
than one of the same age that has been quenched into the ordered phase. The 
dynamics in isothermal conditions is basically identical in both cases but the starting 
configuration at the final temperature T is however very different, the annealed 
system looking older than the quenched one. The presence or absence of cooling 
rate dependences as well as the effect of temperature on the low-T dynamics allow 
one to distinguish among different glassy system. We shall come back to this issue 
when discussing structural and spin glasses. 

On the right panel of Fig. 1 we plot the two-welled Landau free-energy density 
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f(m) against m. Transverse to the m direction there are 2 L — 1 other directions that 
complete the phase space of the spin model. Note that when L — > oo phase space is 
infinite dimensional even if real space is finite dimensional, d < oo. If one wishes to 
view the dynamics as the wandering of a point, that represents the instantaneous 
configuration of the system, in the free-energy landscape, the one-dimensional plot 
in Fig. 1 might be useful only if used carefully. The initial configuration after a 
quench corresponds to the top of the barrier (m = 0). This unstable point hides 
the 2 Ld — 1 ^> 1, for L ^> a, transverse directions (a is the lattice spacing). The 
domain growth process takes place while the representative point sits on the top 
of the barrier. Falling into one well corresponds to the growth of the conquering 
domain. Finally, jumping over the barrier is the activated process of reversing the 
full system. As long as t < t REQ the dynamics is highly non-trivial while viewed on 
this plot it looks trivial, with the representative point simply sitting on the border 
between the two basins of attraction of the equilibrium states m = ±m EQ [3]. 

Importantly enough, both t REQ and t ERG grow with L and, if the thermodynamic 
limit L — > oo is taken at the outset, diverging times with L cannot be reached and 
physical times are always smaller than t REQ . The system cannot equilibrate with its 
environment and the non-equilibrium domain growth process goes on for ever. 

2.2 Glasses 

The domain growth example is very useful to visualize a non-equilibrium evolution. 
The mechanism behind the dynamics is clear and the growth of order can be easily 
identified. In other systems that undergo a non-equilibrium evolution whether there 
is a growing order controlling the evolution is still an open question. Glassy systems 
are one such example. 

Understanding the glass transition and glassy dynamics is one of the greatest 
challenges in theoretical physics. The glassy problem can be summarized as fol- 
lows [4]. Take a liquid at high temperature Tj and quench it at a constant rate, 
r = —AT/ At. On each temperature step, the viscosity relaxes rather quickly and 
with a simple analysis one estimates its asymptotic value to trace a curve rj(T) that 
is sketched in the left panel of Fig. 2 (red curve). This curve has several remark- 
able features. At very high temperature r](T) very slowly grows with decreasing T. 
Decreasing the external temperature still the system approaches the crystallization 
(or melting) transition T m . If the cooling rate r is sufficiently fast, this transition 
is avoided and the system enters a metastable super-cooled liquid phase where the 
viscosity grows very quickly with decreasing T. Indeed, one typically observes that 
when T changes by, say, 100°C, the viscosity jumps by approximately 10 orders of 
magnitude. In consequence, the dynamics of the liquid slows down enormously. For 
several liquids the form of the rj(T) curve can be described with a Vogel-Fulcher law, 



that predicts a divergence of r)(T) when T — > T Q . These liquids are conventionally 
called fragile. (Within the experimental precision T Q coincides with the Kauzmann 
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temperature Tk where the extrapolation of the difference between the entropy of the 
liquid and the crystal vanish.) However, this fitting procedure can be criticized for 
several reasons. In many cases the form of the fitting function strongly depends on 
the temperature window chosen for the fit. Even more important is the fact that the 
dynamics becomes so slow when T decreases that the time needed to equilibrate the 
sample goes beyond the minimal cooling rate, or the maximum time reachable in the 
experience. Below a temperature T g {> T Q ) one can no longer equilibrate the sample. 
One of the most clear signatures of the absence of equilibrium below T g is the fact 
that the measurement of, e.g., the volume as a function of temperature, depends on 
the cooling rate, r, used to reach T. Moreover, T g decreases with decreasing cooling 
rate. Hence, the so-called "glass transition" is not a true thermodynamic transition 
but a dynamic crossover from the super-cooled liquid phase, where the dynamics 
is slow but occurs as in equilibrium [5], to the glass phase where the system does 
not manage to equilibrate with its environment. These features are schematically 
shown in the right panel of Fig. 2. Going back to the interpretation of Eq. (2.1), some 
authors extrapolate it below T g , where viscosity measurements are not possible, and 
interpret the divergence at T Q as the signature of a true thermodynamic transition. 
This means that even in the limit of vanishing cooling rate one would observe a 
transition from the super-cooled liquid to an ideal glass phase (still metastable with 
respect to the crystal) at T a . Others prefer a scenario in which Eq. (2.1) has no 
meaning below T g . 




Figure 2: Left: sketch of the viscosity against temperature approaching T g . Rough 
comparison between different scaling forms. (Arrhenius: A = 3900C, 770 = 10 _6 P. 
Vogel-Fulcher: A = 500C, T = 100.C, r] = 10P. mct: rj = rj /(T - T d )~< with 
T d = 300C, 7 = 0.7, r] = 1700P.) Right: cooling rate dependence of the volume, 
rl > r2 > r3. 

In this sense, it is important to stress that the viscosity of many glass forming 
liquids, as the silica materials that give rise to window glass, is well fitted by an 
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Arrhenius law 

r ] (T) = Vo exp(^) (2.2) 

that diverges at T — > 0. These are the so-called strong glasses. It has been suggested 
that actually all glasses are strong since one can always fit rj(T) with an Arrhenius 
law if the temperature window used for the fit is close enough to T g (as suggested in 
Fig. 2). This is the reason why some authors prefer a scenario in which the super- 
cooled liquid phase extends all the way up to T = when an infinitely slow cooling 
rate is used. The curve labeled mct in the same figure shows the prediction of the 
models we shall discuss in these notes (p spin models and mode-coupling theory). In 
short, this approach predicts a dynamic transition at Td that is typically higher than 
T g , with a power law divergence of r/. Albeit this and other defects, this approach 
is successful in many respects since it yields a satisfactory qualitative description of 
the phenomenology of super-cooled liquids and glasses. 

For the purpose of our discussion the important point to stress is the fact that 
the liquid falls out of equilibrium at the (cooling rate dependent) temperature T g . 
Indeed, even the "state" reached by the system below T g depends on the cooling rate 
as seen, for instance, in measurements of volume, entropy, etc. as functions of T, 
see the right panel in Fig. 2. The slower the cooling rate, the deeper one penetrates 
below the threshold level corresponding to r —>■ oo. The dynamics below T g occurs 
out of equilibrium since t E q ^ t EX pi see the sketch in Fig. 3. The properties of the 
system cannot be described with the use of P GB and a more sophisticated analysis 
has to be developed. 



t=0 t w t m =t+t w time 

preparation waiting measuring 

time time time 

Figure 3: Characteristic times. The waiting and measuring times are experimental 
times £ EXP . The equilibration time t EQ can be shorter or longer than them leading to 
equilibrium or non-equilibrium dynamics, respectively. 



The above paragraphs were devoted to the discussion of the liquid to glass transi- 
tion and it implicitly assumed that the system was made of molecules in interaction. 
In the case of simple liquids, in which the constituents have no structure, one can 
describe the relevant interactions with a two body potential 

E = Y.V{\n-r J \). (2.3) 

Hard spheres are the simplest example of this kind where the only interaction are 
hard core ones that forbid the penetration of one particle by another. Adding 
polymers in the solution that hosts the spheres one can tune a repulsive interaction 
between the particles. (See Fig. 4-left below for a snapshot of one such experimental 
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system [6].) Favorite potentials used in numerical simulations are the Lennard- Jones 
and soft-sphere ones 



V{\r l -r 3 \)=Ae„ 




) 
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(2.4) 



To avoid crystallization one usually uses a binary system with particles with 
mass rriA and N B particles with mass m B . The parameter oaa fixes the length 
scale, €aa the energy scale and itla the mass scale. The time scale is then given 



by t = y tiT'AO'aa/ e AA- For a given density, e.g. p = 1.2, an adequate choice 
of the remaining parameters yields the expected properties of a liquid or a glass 
with a numerical transition at a temperature T g where the relaxation time goes 
beyond the time accessible with the simulation. In the soft-sphere model one only 
keeps the repulsive term in the potential. Many other types of glasses are known in 
Nature. For instance, plastics as PVC whose mesoscopic constituents are polymers 
also undergo a glass transition very similar to the one described previously. Several 
types of interactions between the monomers that form the macromolecules are also 
of two-body type and they are repertoriated in the literature. The dynamics of 
particle systems is given by Newton's equations. 

2.3 Spin-glasses 

More exotic types of glasses have been studied for long. Spin-glasses have attracted 
the attention of experimentalists and theoreticians as a prototypical system with 
quenched disorder [7, 8, 9, 10]. These systems are magnetic alloys in which mag- 
netic impurities are replaced in a magnetically inert host. The impurities occupy 
random positions and are not displaced within the sample in experimental times. 
The interactions between the impurities depend on the distance between them. Since 
the latter are random, the interactions themselves take random values that change 
in sign very quickly. A number of experimental realizations exist. As in other 
glassy systems, spin-glasses fall out of equilibrium at a transition temperature T g 
when usual cooling rate procedures are used. From experimental and numerical 
results near T g complemented with standard critical analysis, it is rather generally 
believed that the transition between the paramagnetic and the spin-glass phase is, 
in this case, a true thermodynamic transition. This is at variance with what occurs 
in structural and polymeric glasses. Another important difference with structural 
glasses and systems undergoing simple coarsening as ferromagnets is that the mag- 
nitude of cooling rate dependences is quite negligible suggesting that for spin-glasses 
the preferred configurations at one temperature are totally different from the ones 
at any other temperature. Still, slightly farther away from the transition one can 
no longer equilibrate the spin-glasses and observes typical non-equilibrium effects. 

Edwards and Anderson proposed a simplified model for spin-glasses in which 
one represents the magnetic impurities with Ising spins placed on the vertices of a 
three dimensional cubic lattice. The random nature of the interactions are mimicked 
with first neighbors random interactions between the spins taken from a Gaussian 
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Figure 4: Different types of glasses: on the left, a colloidal system (image taken 
from [6]); on the right a representation of the 3d EA spin-glass model. 

(or bimodal) probability distribution with zero mean and variance [J?-] = J 2 /(2z) 
where z is the connectivity of the lattice. (Hereafter we denote with square brackets 
the average over disorder.) The Hamiltonian is 

Hj[S] = -J2J l jS i s 3 . (2.5) 

(v) 

where the vector S encodes the full set of spins in the sample S = (s 1; s 2 , ■ ■ ■ , sjv) 
and (ij) represents nearest neighbors on the lattice. In the fully connected limit in 
which each spin interacts with all others the sum runs over all pair of spins and the 
unusual normalization of the J^-s, [J?-] = J 2 /(2N), ensures a correct thermodynamic 
limit. This is the Sherrington - Kirkpatrick (sk) model 

For many years it was common lore that the presence of explicit quenched disor- 
der made spin-glasses intrinsically different from glasses where no quenched random 
forces have been identified. This belief was in part motivated by the analytical 
treatment used to study the equilibrium properties of the spin-glass phase in SK, 
namely, the replica trick. More recently, after a series of seminal papers by Kirk- 
patrick, Thirumalai and Wolynes [11], and the later solution to the non equilibrium 
dynamics of several glassy models [12, 13], it has been realized that the presence 
of quenched disorder is not that relevant. All glasses can be analyzed on the same 
footing. The schematic mean-field model for glasses, the p spin model, has quenched 
Gaussian interactions and its Hamiltonian is 

H j[S] = ~ Jhn-ivSi^ ...3^. (2.6) 

(i-ii 2 ...i p ) 

{[J h ...i p ] = and [J?...J = J 2 p\/(2NP- 1 ), we henceforth set J = 1.) Glauber's rule 
for Ising spins or Langevin equations for soft spins define the microscopic evolution. 

2.4 Quantum fluctuations 

Different driving dynamics slightly modify the picture just presented. Quantum 
glassy phases, where quantum fluctuations are at least as important as thermal ac- 
tivation, have been identified in a number of materials. Two such examples are 
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the spin glass compound and the amorphous insulator studied in [14] and [15], re- 
spectively. Another interesting realization is the so-called Coulomb glass in which 
localized electrons interact via Coulomb two-body potentials and hop between local- 
ization centers [16]. In all these systems the dynamics is extremely slow and strong 
history dependence as well as other glassy features have been observed. 

Models for magnetic compounds are constructed with SU (2) spins while models 
for particle systems are quantized with the usual commutation relations between 
coordinate and momenta. In both cases the dynamics is fixed by Heisenberg equa- 
tions. 

2.5 Rheology and granular matter 



Rheometer 




Figure 5: Left: A Couette cell used to shear a liquid. The internal and external 
walls turn with opposite angular velocities and the fluid is included in between them. 
Right: a cut of the Couette cell, (pbc: periodic boundary conditions.) 

The above examples concern systems that are not able to reach equilibrium with 
their environments in a reasonable time but that, let evolve on astronomical time- 
scales, will eventually equilibrate. Other ways of establishing non-equilibrium states 
with slow dynamics are possible if one externally drives the samples [17]. 

A dense liquid can be driven to a slow out of equilibrium stationary regime by a 
weak shear. A shear is an example of a force that does not derive from a potential, 
i.e. it cannot be written as / = —dV/dr. The simplest way to apply a shear on a 
liquid is by means of a rheometer. In Fig. 5 we show one with a Couette geometry. 
The shear modifies the dynamic equations for the fluid by adding an advection 
vVp(f,t). In the planar limit v = jye x where v is the velocity of the fluid, p its 
density and 7 the shearing rate. One mimics such a force in a spin system with a 
non-symmetric force, i.e. the force exerted by the spin i on the spin j is not equal 
to the force exerted by the spin j on the spin i [18, 19], e.g. 

fi = Jij s j witl1 Jij 7^ Jji ■ ( 2 - 7 ) 

(The motivation to define such a force comes from neural nets where the synapsis 
have a direction.) It is clear that this force cannot be written as the variation of 
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a potential energy with respect to Sj, it violates detail balance, and an equilibrium 
measure cannot describe its effects [20]. 

A weak shear has a spectacular effect on the relaxation of liquids [21]. Usually, 
the viscosity as a function of the shear rate, 7, has a Newtonian plateau at small 7 
that crosses over to a decreasing function that is approximately given by 77 7~ 2 / 3 . 
Hence, by shearing the liquid one facilitates its flow and the relaxation time decreases 
with increasing 7. Moreover, one introduces a shear-dependent time scale t SH that 
plays an important role in aging experiments as discussed in Section 2.7. 

Another family of materials that have captured the attention of experimentalists 
and theoreticians in recent years is granular matter [22] . Since the potential energy 
needed to displace a macroscopic grain by a distance equal to its diameter, mgd, 
is much larger than the characteristic thermal energy, fc^T, thermal activation is 
totally irrelevant for systems made of macroscopic grains. Therefore, in the absence 
of external driving granular matter is blocked in metastable states and there exists 
no statistical mechanics approach capable of describing its static behavior. Instead, 
when energy is pumped in in the form of shearing, vibration or tapping, transitions 
between the otherwise metastable states occur and granular matter slowly relaxes 
towards configurations with higher densities. When trying to model these systems 
it is also important to keep in mind that dissipation is not given by the usual 
Ohmic form proportional to the velocity of the grains, — 77;, but it is much more 
cumbersome. Glassy features such as hysteresis as a function of the amount of energy 
injected, slow dynamics [22], and non stationary correlations [23, 24, 25] have been 
exhibited. 

The effect of the external drive can be described by applying time- dependent 
oscillatory forces, e.g. fi(u>,t) = Asm(ut), to each spin variable in model (2.6) [26]. 
One could also include complicated sources of dissipation by modifying the noise 
kernels obtained in Section 4 for a usual equilibrated bath. 



2.6 Elastic manifolds in random potentials 



The motion of a d dimensional directed elastic manifold embedded in an N dimen- 
sional space in the presence of quenched random disorder has a bearing in several 
areas of physics [27, 28]. (The total dimension of space is d + N.) The case d = 
represents a particle in a random potential. With d — 1, N — 2 and an attractive 
punctual disorder one models, for instance, a single vortex in a dirty superconduc- 
tor. When d — 2 and N — 1 one describes the dynamics of a directed interface in 
three dimensions. The standard model is 



H = J d d x [(V$(f)) 2 + V($,x) 



(2.8) 



where <3>(a?) = ($1, . . . , $n)(x) and x = (27, . . . , xj) represents the transverse posi- 
tion of the point x on the manifold and V(&, x) is a Gaussian random potential, with 
zero mean and correlations [V($, x)V(&, x' )] = -AO 7 [($ - &) 2 /n] 5 d (x-x'). 

The study of these problems has been boosted by the advent of high-T c super- 
conductivity. Other physical systems that are modeled with similar Hamiltonians 
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are Wigner crystals, vortex lattices, charge density waves, etc. in the presence of 
disorder. All these problems have an underlying periodic structure that is modified 
by elastic distortions, topological defects and external quenched disorder. They can 
be set into motion with an external force and the velocity-force characteristics has 
several interesting features that have been much studied. One observes a depinning 
transition at T = 0, creep dynamics when the applied force is weak and T > 0, hys- 
teresis, etc. (The driven motion is achieved, for instance, by applying an external 
current in the case of the vortex systems and the current-voltage characteristics is 
monitored.) The relaxational and driven dynamics of these systems show similarities 
but also marked differences with that of glasses and spin-glasses that are possibly 
due to the existence of an ordered underlying structure. 

2.7 Aging 

Aging means that older systems relax in a slower manner than younger ones [29]. 
One defines the age of a system as the time spent in the phase under study. For 
instance, the age of a system that is suddenly quenched from high-T to low-T is 
simply t w . The aging properties are studied by monitoring the time evolution of 
correlation and response functions. In the former experiments one lets the system 
evolve and compares its configuration at the waiting-time t w with the one reached 
at the subsequent time r + t w . In the latter one perturbs the system at t w with, 
e.g. a dc or an ac field, and follows the evolution of the linear response to the 
perturbation. In the glassy phase both correlations and responses depend on t w in 
an aging manner and, within the experimentally accessible time-window, this trend 
does not show any tendency to stop. At temperatures that are close but above T g 
one observes "interrupted aging", that is, a dependence on the age of the system 
until it reaches the equilibration time (t w > t EQ ) where the dynamics crosses over 
to an equilibrium one. In equilibrium correlation and response measurements are 
related in a system independent manner by the fluctuation-dissipation theorem (see 
Section 7). Out of equilibrium this general relation does not hold and, as we shall 
explain in Sections 13 and 14, important information can be extracted from its 
modifications. 

Aging has an easy interpretation within coarsening systems. While the aver- 
aged domain size lZ(t w ) grows with t w , its rate of increase dt w lZ(t w ) decreases, 
e.g. d tw 1Z(t w ) ~ tU, z ~ l in the example explained in Section 2.1. The motion of 
interfaces slows down as time elapses. Comparing the configuration at t w and at 
a later time r + t w , one finds a clear separation of time-scales depending on the 
relative value of r with respect to t w . If r <S T (t w ) = l/d tw lnlZ(t w ), one has 
TL(t + t w ) ~ 7Z(t w ) + d tw TZ(t w )T ~ TZ(t w ), and the domain walls do not move. The 
overlap between the configurations at t w and r + t w is a sum of overlaps between 
domains of one and another type. (This holds when the ratio between the number 
of spin in the surface of the domains and in the bulk vanishes in the thermody- 
namic limit. Some non-standard systems have fractal scaling of the interfaces and 
the volume of the domains might also have a fractal dimensionality [30].) Due to 
thermal fluctuations within the domains, the correlation decays as in equilibrium 
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from 1 at equal times to m EQ (T) when r increases while still satisfying the constraint 
r <C T (t w ). For r's beyond this limit, the correlations decay below m^ Q (T) since 
the interfaces move and one compares configurations with very different domain 
structures as shown, for instance, in the two snapshots in Fig. 1. 

In structural glasses, a pictorial explanation of aging is also possible imagining 
that each particle sees a cage made of its neighbors. When r is short compared 
to a characteristic time To(t w ) each particle rapidly rattles within its cage and the 
decorrelation is only characterized by thermal fluctuations. The correlations decay 
in a stationary manner from its value at equal times to a value called q EA that will 
be defined precisely in Section 12 [in the domain growth example q EA = m^ Q (T)]. 
When r increases, the motion of the particles destroys the original cages and one 
sees the structural relaxation. The waiting-time dependence implies that the cages 
are stiffer when time evolves. The motion of a tagged particle is depicted in the left 
panel of Fig. 4 [6]. One sees how it first rattles within a cage to later make a long 
displacement and start rattling within another cage. 

In spin-glasses no consensus as to which is the origin of aging has been reached. 
Still, the qualitative behavior of correlations and responses is rather close to the 
one in domain growth and structural glasses. In Fig. 6 we show the decay of the 
thermoremanent magnetization (an integrated linear response) and the correlations 
between the fluctuations of the magnetization in a spin-glass [31, 32]. 

Shearing may have a very strong effect on an aging system. In some cases it 
introduces a characteristic time t m that yields the longest relaxation time. Thus, 
aging is interrupted for waiting-times that are longer than t SH (see Fig. 7). This effect 
has been known for long experimentally [21] and it has been found and explored 
recently within the theoretical framework that we review [33, 34]. Experiments in 
other soft glassy materials with aging and aging interrupted by shear can be found in 
[35] . Some examples where the effect of shearing is not as spectacular are also known. 
For instance, in a phase separating mixture sheared in one direction the domains 
stop growing in the transverse direction while they continue to grow longitudinally 
(see [19] and references therein). This is a subject of intensive research. 

Granular matter is usually driven with periodic forces or tapping. These pertur- 
bations pump energy into the system that is evacuated via friction and introduce a 
time-scale t sc that is simply the period of the oscillation. How these forces influence 
the aging properties is much less known and it is the subject of current investiga- 
tions. For the moment, most of the work in this direction has been numerical [24, 25] 
and also analytical within the kind of models we shall solve [26] (see [23] for some 
experimental studies). 

The aging properties of relaxing manifolds in random potentials have been found 
analytically [36] and numerically [37]. The experiment of Portier et al [38] shows 
aging features in a high-T c superconductor [39] that are also observed numeri- 
cally [40, 41]. However, other experimental studies using different protocols have 
not exhibited these properties [42] . More experiments are needed to get a better un- 
derstanding of the non-equilibrium relaxation of these systems. An external electric 
current drives a vortex system in its transverse direction due to Lorentz forces. How 
the longitudinal and transverse aging properties of the system are modified in the 
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moving phases is another problem that deserves further study [43]. The comparison 
between the dynamics of the moving vortex lattice, the tapped dynamics of granular 
matter and the sheared dynamics of dense liquids is also interesting and begins to 
be done. 




Time difference t=t-t' (s) Time difference t=t-t' (s) 



Figure 6: Aging in the thiospinel insulator spin-glass. Decay of the thermoremanent 
magnetization (left) and correlations between magnetic fluctuations (right). From 
left to right curves for increasing waiting-times. Inset: scaling. (Curves taken 
from [32], see [31] and [32] for details.) 




T (ms) T (ms) 

Figure 7: Aging and interrupted aging in laponite. Decay of the correlation function 
in a relaxing (left) and a sheared (right) sample. In the aging case different curves 
correspond to increasing waiting-times from left to right, t w = 10, 20, 30, 40, 50 min. 
(note that the decay occurs for r ^t w since the waiting-times are rather short and 
the sample is still very far from equilibrium; cfr. with the results in A. Knaebel et 
al in [35]). In the sheared case, the sample has been let wait for t w — 1 h, four shear 
rates, 7, with values indicated in the key were applied at this instant and the decay 
of the stationary correlation was recorded [44]. 



2.8 Summary 

In this Section we introduced several examples of macroscopic systems that evolve 
with a slow non-equilibrium macroscopic dynamics. The microscopic dynamics gov- 
erning the evolution of the constituents of each system is very different. For systems 
undergoing domain growth and classical glasses, T is the external control parameter 
that generates fluctuations. For glasses at very low T thermal fluctuations are al- 
most completely irrelevant while quantum fluctuations become important and drive 
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the dynamics. For granular matter T is again irrelevant and the systems' relaxation 
is due to the external drive. In the elastic systems an underlying ordered structure 
is visible and may cause important differences in the macroscopic dynamics with 
respect to other glassy systems where no quasi order has been identified. An ubiqui- 
tous phenomenon in these slowly evolving systems out of equilibrium is (sometimes 
interrupted) aging or the breakdown of stationarity. Even if all these systems seem 
to be totally different, a common formalism to study their macroscopic dynamics is 
now being used and a common picture starts to develop. 

In the rest of these lectures we shall explain the main technical tools needed to 
study simplified models for these real systems. We shall describe the main features 
of the out-coming scenario making contact with the phenomenology introduced in 
this Section. 

3 Theoretical approach 

Besides many phenomenological descriptions of the glass transition and glassy dy- 
namics proposed long ago, recently, several theoretical approaches have been devel- 
oped. In the following we briefly describe some of the main ones. 

Dynamics in the phase space. 

The instantaneous configuration of the full system is a point in phase space that 
moves as time goes on (see the right panel in Fig. 1). In a whole family of models 
one assumes a free-energy landscape on phase space with wells and barriers and 
proposes that the point evolution is given by some dynamic prescription on this 
space. Choosing a convenient distribution and organization of wells and barriers, 
aging effects are captured by such models. (An average over different systems or 
over different parts of the same system is implicitly assumed in order to obtain 
smooth results for the observables.) In "trap models", for instance, each well has 
an associated trapping-time such that once the system falls in the trap it has to 
wait this trapping-time to escape from it. A useful choice is a Levy distribution of 
trapping-times that is not bounded (this is related to assuming that the depth of 
wells is not bounded from below). The dynamics is such that whenever the point 
leaves a trap a complete "renewal" takes place in the sense that in the next time step 
it chooses any trap from the ensemble with equal probability. For simple probability 
reasons one can prove that at a time t w after the starting time the system will be 
trapped in a well with life-time ~ t w . This model is due to J-P Bouchaud and it 
leads to aging [45, 46, 47, 48] (for other trap models in the glassy context see [49]). 

Domain growh. 

A different approach most commonly used to describe the dynamics of spin- 
glasses assumes that the evolution is driven by the growth of domains of two (or 
a few) competing phases. The non-equilibrium dynamics is then very similar to 
ferromagnetic coarsening slowed down by the existence of disorder and/or competing 
interactions. To obtain concrete predictions one either uses scaling arguments that 



20 



lead to the "droplet model" for spin-glasses [50] and its extension to other glassy 
systems or one solves exactly simple models in low dimensions, typically d — 1 [51, 
52]. A drawback of this approach is that it has been hard to identify the growing 
structures in glassy systems. 

Kinetic models. 

A third approach used to model the dynamics of glasses consists in proposing 
purely kinetic models with no underlying energy function. The dynamic rules are 
chosen so as to slow down the dynamics and lead to a dynamic arrest at some 
critical temperature or density. Interestingly enough some tunning the nature of 
the constraints these models may behave as strong, fragile or may even show a 
fragile-to-strong crossover and they can have non-trivial long-lasting nonequilibrium 
dynamics without having an underlying static transition. Several such models exist, 
see [51] for a collection of articles on this subject and [53]. 

Mean-field models. 

Many of the recent developments in the understanding of the similarities in the 
behavior of a priori so different systems as the ones described in Section 2 are based 
on the analysis of mean-field models. These models are defined by Hamiltonians 
with long range interactions [e.g. sum over all pairs of spins in Eq. (2.5)] or in 
infinite dimensions [e.g. take N — > oo in Eq. (2.8)]. Sometimes it is convenient to 
include quenched disordered interactions though this is not necessary. 

The static properties of these models are accessible by the usual statistical me- 
chanics analysis complemented by the less standard replica trick when disorder ex- 
ists [9]. The organization of metastable states or, in other words, the full struc- 
ture of the relevant Landau-type free-energy landscape, is also accessible with time- 
independent calculations called tap approach in the context of spin-glass theory [56]. 

As for dynamics we first have to define how the microscopic variables evolve in 
time. In classical particle systems Newton equations determine their evolution. In 
quantum systems Heisenberg equations do the same. Since in realistic situations the 
systems of interest are in contact with their environments we present the modeliza- 
tion of the coupled systems in Section 4. We show how the effect of the environment 
translates into noise in both cases. For classical models the elimination of the bath 
variables leads to Langevin equations. Non-potential forces and vibrations in clas- 
sical systems are easily included by adding terms to the Langevin equations. Once 
the microscopic dynamics is given the techniques described in the rest of the notes 
allow us to solve these schematic models. 

These models capture many properties of real systems. Nevertheless, their mean- 
field character implies many drawbacks. For example, one finds that they have sharp 
dynamic (with no thermodynamic anomaly) and static transitions at temperatures 
Td and T s , (7^ > T s ). The relationship between the dynamic solution and the or- 
ganization of metastable states in the relevant free-energy landscape can be made 
precise and it allows us to understand the existence of these two separate transitions. 
In real systems, however, there is no sharp dynamic transition since T g is actually 
a crossover, while T s might not exist (recall the discussion on T Q in Section 2.2). 
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In spite of this and other defects, one of the interests in these models and their 
solutions is that they have a great power of prediction of so far unknown effects and 
that they act as a source of inspiration for searching new features in the numerical 
and experimental study of more realistic models and systems. The rather accurate 
comparison to numerical simulations [57, 58, 59], and, to the extent of their avail- 
ability, experiments [31, 60, 61, 62, 32], supports the proposal that the mechanism in 
these models is similar to the one responsible for the glass transition, and the glassy 
dynamics, in real materials. Indeed, there is growing consensus in that they provide 
an exaggerated realization of the actual glassy phenomenon. It is worth mentioning 
too that some of the features found in the mean-field models that we shall explain 
below have also been analysed within the other approaches mentioned above. 

In the following we present the asymptotic analytic solution to this family of 
models. Some of the ingredients missing in their full analytic solution, that would 
render their description of real materials more accurate, have been identified (anal- 
ysis of the dynamics in time-scales that diverge with N, description of dynamic 
heterogeneities, etc.). For the moment, their complete analytical treatment has 
proven too difficult but some recent articles report partial success and suggest in- 
teresting ways to follow up. We shall come back to these issues in the Conclusions 
and Perspectives. 

4 Systems in contact with environments 

In the typical experimental protocols discussed in Section 1 one quenches the sample 
and subsequently follows its evolution in time. Once arrived at the final point in 
parameter space, if no external forces are applied, the system relaxes and its energy 
density decreases towards an asymptotic value. Hence, the system is not isolated, 
but in contact with an environment that acts as a source of dissipation. The system 
plus environment is "closed" while the system alone is "open". The first question 
to answer is how to model the coupled classical and quantum system. 

4.1 Modeling the coupled system 

The nature of the environment, e.g. whether it can be modeled by a classical or a 
quantum ensemble, depends on the problem under study. The choice of the coupling 
between system and environment is determined by the symmetry properties of the 
system and by physical intuition. Weiss' textbook [63] has a very complete descrip- 
tion of this problem. We here explain the main ingredients of the modellization. 
The generic problem we want to study is 

H TOT = H SY ST + H ENV + H 1NT + -/^COUNTER • (^-l) 

Until otherwise stated, we focus on a single particle coupled to an environment. 
if SYST is the Hamiltonian of the isolated particle, H SYST = p 2 /(2M) + V(q), with 
p and q its momentum and position. H wv is the Hamiltonian of a thermal bath 
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that, again for simplicity, we take to be an ensemble of N independent harmonic 
oscillators 

^-|^ + ^. («) 

This is indeed a very usual choice since, for example, it may represent phonons. 
.ffi NT is the coupling between system and environment. We restrict the following 
discussion to an interaction that is linear in the oscillator and particle coordinates, 
-Hint = ?Ef=i V«! with c a the coupling constants. The calculations can be easily 
generalized to an interaction with a more complicated dependence on the system's 
coordinate, F(q), that may be dictated by the symmetries of the system. We discuss 
the last term, if C0UNTER , below. 



4.1.1 Statics 



Classical problems 

Let us first show how the static properties of a classical system are modified by 
its interaction with a classical thermal bath. If the coupled system is in equilibrium, 
it is described by a partition function given by a sum over the combined phase 
space of the system and environment. Having chosen a bath of harmonic oscillators, 
the integration over the bath variables can be readily performed; this calculation 
yields the reduced partition function that is written as an integration over the phase 
space of the system only. One can easily prove that the mass of the system gets 
(negatively) renormalized due to the coupling to the environment [64]. Therefore 
one introduces the counter-term 

1 ^ C l 2 

-^COUNTER = 77 /, 9 Q (4-3) 

2 ^ m a uJ 2 a 

in such a way to eliminate the mass renormalization and to recover the partition 
function of the isolated system. 

Quantum problems 

If one includes quantum fluctuations to describe the system and environment, 
the situation is slightly more complex. The relevant quantity to study is the density 
matrix of the full system that, for instance, can be represented as a path integral 
on imaginary time [65] . The contribution of the environment to the effective action 
is quadratic and its variables can be integrated away to yield a reduced density 
matrix. As opposed to the classical case, the interaction with the reservoir not only 
induces a (negative) mass renormalization but it also generates a retarded quadratic 
interaction 

r/3h fT 

/ dr dr' x(t)K(t -t')x{t') (4.4) 

JO JO 

controlled by the kernel 

= -- n E / du> — -^- 2 exp(^r) , (4.5) 
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with v n the Matsubara frequencies, v n = 27rn/h(3, n an integer in (—00,00) and 
I(uo) the spectral density of the bath, 

7T N » c 2 

= - £ -*>-6(u> - uj a ) , (4.6) 

that is a smooth function of uj usually taken to be I{uj) = ^uj [ujjuj^) s ~ x exp(— 00/ A) , 
with 7 the "friction coefficient", u s a constant, A a high frequency cut-off and s a 
parameter that characterizes different baths: s = 1 is Ohmic (and leads to the usual 
white noise when A — > 00), s > 1 is super-Ohmic and s < 1 is sub-Ohmic. As in the 
classical case, one includes a counter-term to cancel the mass renormalization but 
the retarded interaction (4.4) cannot be eliminated. 



4.1.2 Dynamics 

The distinction between the effect of a reservoir on the statistic properties of a 
classical and a quantum system is absent from a full dynamic treatment where the 
coupling to the environment always leads to a retarded interaction. In classical 
problems one generally argues that the retarded interaction can be simply replaced 
by a local one, i.e. one uses white noises, if long enough time-scales are explored. 
In quantum problems the same simplification is not justified in general. 

Classical problems 

The dissipative dynamics of a classical system in contact with an environment is 
usually described by a phenomenological Langevin equation. If the system is simply 
given by a particle of mass M, whose position is denoted by q, this equation reads 

Mq(t) + f Q dH l(t-t')q(t') = -V'(q(t))+t(t) (4.7) 
(t(t)W)) = ksT^t-t') (4.8) 

where "f(t — t') is a retarded friction and £(£) is a time-dependent Gaussian random 
force with zero mean and correlation given by Eq. (4.8). We adopt angular brackets 
to denote averages over the noise. 

The Langevin equation was first introduced in the context of Brownian motion 
and later used in a variety of problems with dissipation. It can be derived from 
the coupled system defined in Eq. (4.1) [66, 63] (see Appendix A). Indeed, if one 
assumes that the initial coordinates and momenta of the oscillators have a canonical 
distribution at an inverse temperature j3 [shifted by the coupling to the particle 
^0(0) y x a (0) — c a /(m a uj^)q(0) ], Newton's equation for the evolution of the particle 
becomes Eq. (4.7). The random nature of the force £ is due to the randomicity 
in the initial values of the position and momenta of the oscillators. The use of 
an equilibrium measure for the distribution of the oscillators implies the invariance 
under time translations of the friction kernel, j(t — t'), and its relation to the noise- 
noise correlation in Eq. (4.8). The latter is a fluctuation-dissipation theorem that 
holds for the bath variables (see Appendix A and Section 7). Different forms of 
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^{t—t') can be generated by different choices of the ensemble of oscillators. Typically, 
the decay of j(t — t') occurs in a finite relaxation time, T£. When the minimum 
observation time is of the order of or shorter than Tg one has a "colored noise". 
Instead, when it is much longer than r^, any time difference satisfies t — t' ^> 
and the kernel can be approximated with a delta function ^{t — t') ~ 2^5{t — t'), 
which corresponds to a white noise. For the classical problems we shall deal with 
the white-noise approximation is adequate. 

Once the Langevin equation has been established on a firmer ground, it can 
be used as a starting point to study the dynamics of more complicated classical 
systems in contact with classical environments. The description of the dynamics of a 
macroscopic system with dissipation is then given by N coupled Langevin equations 
with N the number of dynamic degrees of freedom. (In this case one usually couples 
an independent set of oscillators to each microscopic variable of the system, other 
choices lead to more complicated equations.) Time-dependent, fi(t), and constant 
non-potential forces, /f p , as the ones applied to granular matter and in rheological 
measurements are simply included as part of the deterministic force. In the white 
noise limit 



A continuous Langevin equation for classical spins is usually written replacing 
the hard Ising constraint Sj = ±1 by a soft one implemented with a potential term 
of the form V(si) = u(sj — l) 2 with u a coupling strength that one eventually takes 
to infinity. The soft spins are continuous unbounded variables s« G (—00, 00) but the 
potential energy favors the configurations with s; close to ±1. Even simpler models 
are constructed with spherical spins, that are also continuous variables globally 
constrained to satisfy X^Li sf = N. 

Quantum problems 

Even if several attempts to write down quantum versions of the Langevin equa- 
tion appeared in the literature, these methods remain very much model dependent 
and difficult to generalize [63]. A more convenient way to analyze the dynamics 
of a coupled system and environment with quantum fluctuations is the functional 
Schwinger-Keldysh formalism. We postpone the discussion of the effect of the quan- 
tum reservoir on the quantum system to Section 8 where we introduce this formal- 
ism. In short, the effect of the environment is to introduce retarded terms in the 
dynamic action that are similar to the ones in Eq. (4.4) but in real time. The white 
approximation is not acceptable and one is forced to keep the non-local in time 
kernels. 

5 Observables and averages 

As usual in statistical and quantum mechanics meaningful quantities are averaged 
observables. For an equilibrated system, due to ergodicity, one can either take 



2 1 k B T5 ij 5{t-t') . 




(4.9) 



mm) 



(4.10) 
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an ensemble average or an average over a sufficiently long time-window. Out of 
equilibrium these do not coincide in general. In this Section we define averaging 
procedures for classical and quantum problems out of equilibrium and we set the 
notation used in the rest of the notes. 



5.1 Classical systems 

The interaction with the environment induces fluctuations and the Langevin equa- 
tion is solved in a probabilistic sense, 

O)=-H(60, <»>,*]■ (5-1) 

The index k labels different realizations of the thermal history, i.e. different real- 
izations of the noise at each instant. q is the initial condition q = q(0) and 
encodes all noise values in the interval [0, t]. We discretize time, t a = a5 with 5 the 
time spacing and a = 0, 1. . . . The total time is t — ST. We shall be interested in 
the limit T — > oo and 5^0 with t fixed. Equation (5.1) means that there is a 
different solution for each noise history. 

Any one-time functional of q, A[q](t), must be averaged over all histories of the 
thermal noise to obtain a deterministic result 

(A[q](t)} = lim £ A[<g](t)P(t k ) = f V^P® A[qf\{t) . (5.2) 

M is the number of noise realizations. P{£k) is the probability distribution of the 
fc-th thermal history. For a Gaussian noise 



P(f fc ) oc exp 



(5.3) 



The measure of the functional integral is just = n a d£(ta)- 

Two-time functions characterize the out of equilibrium dynamics in a more de- 
tailed way and they are defined as 

C AB (t,t') = (A[q](t)B[q}(t')) = J VZP(OA[qf](t)B[qf}(t') . (5.4) 

The observable B[q] is measured at time t', the observable A[q] is measured at time 
t for each noise realization and the average is taken afterwards. 

The instantaneous linear response is also a two-time function. Imagine that q 
represents the position of a Brownian particle that one kicks with a weak perturbing 
force at time t' = t a (see Fig. 8). The subsequent position of the particle is modified 
by the perturbation. The linear response is given by the comparison of the perturbed 
dynamics with the unperturbed one, in which no force has been applied, up to linear 
order in the perturbation: 



Sh B (t') 



(5.5) 

h B =0 
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*a-2 Vl *a W1W2W3 *a-2 Vl 'a Wl l a+2^a+3 

Figure 8: Left: an instantaneous perturbation applied at t a . Right: a step pertur- 
bation applied at t a and held constant for all subsequent times. 

The subindex B indicates that the perturbation applied at if is conjugated to the ob- 
servable B[q] when the Hamiltonian is modified as H — ► H — hsB\q\. The subindex 
A indicates that we examine how the observable A[q] at time t reacts to the pertur- 
bation. At the end of the calculation we set hs = to extract the linear response. 
Keeping h B 7^ yields information about the nonlinear terms in the response func- 
tion. For causal systems the response function vanishes if t! > t. 

In future Sections we shall be interested in the integrated linear response rather 
than the instantaneous one. This quantity represents the linear response of the 
system to a step-like perturbation of duration t — t' that starts at t', as represented 
on the right panel of Fig. 8: 

X AB(t,t')= f dt" R AB (t,t") . (5.6) 

Rather often results are presented in the frequency domain. One defines the 
Fourier transform and its inverse 

roc rco (jjjj 

A(u) = / dt exp (-itot) A(t) , A(t) = — exp (iut) A(u) . (5.7) 



00 



2tt 



For a stationary process, the linear susceptibility, x(. u ), is simply given by the Fourier 
transform of the linear response (5.5). However RAB(t,t') is not necessarily station- 
ary out of equilibrium. Hence, we define two generalized linear susceptibilities, 

(11 f°° 
XA B (v,t) = / dr exp(-iujr) R AB (t' + r,t') , (5.8) 
Jo 

(2) f°° 
X AB (uj,t) = / dr exp(-iur) R AB (t,t - t) , (5.9) 
Jo 

that reduce to the well-known expression for Xab{^) in a stationary system. Note 
that in the first line we kept the shorter time (£') fixed while in the second line we 
kept the longer time (t) fixed. These expressions have a real and an imaginary part 
that yield the in-phase (%') and the out-of-phase (x") susceptibilities, respectively. 
The integrations run over positive values of r only due to causality. 

Up to this point we have discussed the simple case in which observables only 
depend on time. More generally, one is interested in extending the above definitions 
to field theories. In the context of liquids, glasses, etc. the generic observables A 
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and B depend on the positions and momenta of the particles. A key quantity is 
the density p(f,i) = J2a=i — f a ), where r is a d dimensional vector in real space 
and f a are the positions of the N particles in the system. From the density- density 
correlator N~ 1 G(f,t;f',t') = (p(r r + f,t)p(r > ,t')) one defines the more useful van 
Hove correlator G VH (f; t , t') = J d d r' G(f,t;r',t'), that measures the probability of 
finding a particle i within a volume d d r around the point fat time t given that there 
was a particle j at the origin at time t' . The normalization factor fixes the number 
of particles, / d d rG VH (f,t) = N. The density-density and van Hove correlators 
can be naturally separated in two contributions, a self and a distinct part. In the 
former, one adds over equal particles only while in the latter one adds over distinct 
particles. The two-time intermediate scattering function is constructed with the 
components of the real-space Fourier transform of the density at different times: 
JV _1 F(A;; t, *') = (p(M)P*(M')) = (P$,t)p(-k,t)). When times are equal one 
recovers the structure factor, S(k;t) = F(k;t,t) that at long times approaches a 
limit S(k; t) — > S(k) even for glassy systems. 

The two-time intermediate scattering function is measurable via neutron scat- 
tering. Indeed, one can easily extend the proof described e.g. in [67] to the non- 
equilibrium case, to show that the cross-section per nucleus is related to the in- 
termediate scattering function. This relation suggests to call the self and distinct 
correlators, incoherent and coherent ones, respectively. Many times, one defines 
the correlators of the local density fluctuations, 8p(f,t) = p(f,t) — (p(f,t)). The 
modification of the correlations defined above follow straightforwardly. A detailed 
description of the properties of these correlations in an equilibrated liquid can be 
found in [67]. 

Up to now we have only discussed one-point and two-point functions. In general 
problems, higher order functions are not trivially related to the previous ones and 
bear richer information. These are four-point functions, (A(t)B(t')C(t")D(t")) , or 
any other form of a more general type. In most of the solvable models we shall discuss 
below, and in most of the approximations used to analyze realistic models, higher- 
order functions do not appear. The reasons for their disappearance are manifold. 
In simplified models one can simply prove that higher order functions are exactly 
given in terms of one and two-point functions. In more realistic cases, higher order 
functions are approximated with expressions that depend on one and two-point 
functions only. This is done, for instance, in Gaussian approximations and mode- 
coupling theory. However, a complete solution to a finite dimensional model should 
be able to predict the behavior of such higher order correlations. 

5.2 Quantum problems 

A quantum mechanical operator, A, in the Heisenberg representation evolves ac- 
cording to 

A(t) = exp (*!*) i(0) exp (-*!*) . (5.10) 

Ensemble averages are defined as (A(t)} = Tr (A(t)/5(0)) /Trp(0), where p(0) is 
the initial density operator and the trace is defined in the usual way, Tr[«] = 
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J^ai^al • \i>a), with an orthonormal basis in Fock space. The normaliza- 

tion factor is the partition function Z = Trp(O). Two-time dependent corre- 
lation functions are introduced as {A{t)B{t')) = Z^Ti (i(t)B(t')p(0)). Clearly 

{A(t)B(t')) ^ (B(t')A(t)) and one can define symmetrized and anti - symmetrized 
correlations: 

CWM') = \{A(t)B(t')+B(t')A(t)), (5.11) 
C [AB] (t,t') = ±(A(t)B(t')-B(t')A(t)), (5.12) 

respectively. The linear response and the integrated linear response are defined just 
as in the classical case, see Eqs. (5.5) and (5.6). In linear response theory, in and 
out of equilibrium, R,AB{t, t') and the anti-symmetrized correlation C[A,B](t,t') are 
related by the Kubo formula [68] (see Appendix B) 

R AB (t, = j:0(t- ( iMt), B(t')} ) = jO(t- t') C[a,b] (t, f ) ■ (5.13) 
5.3 Average over disorder 

Time independent quenched random forces and interactions exist in some of the 
models and systems that we study. We shall be mostly interested in quantities 
averaged over the distribution of disorder that we denote with square brackets [{A)]. 

Averaging over disorder is a delicate matter when one wishes to compute static 
properties. For instance, one has to resort to the sometimes contested replica 
trick [69]. We shall see in Section 8 that in a full dynamic treatment with no 
special initial conditions there is no need to introduce replicas and the formalism is 
totally free from ambiguities. 

6 Time dependent probability distributions 

In Section 4 we derived a Langevin equation with white noise as the microscopic 
dynamic equation controlling the evolution of the classical problems we shall study. 
In this Section we prove some properties of the equilibrium dynamics of classical 
models with dynamics given by these equations. One can simply modify this proof 
for a generic Markov process, a classical problem with colored noise and a quantum 
model. 

6.1 The Fokker — Planck and Kramers equations 

The Fokker-Planck and Kramers equations are particular master equations that 
hold exactly for a Langevin process with white noise. The probability distribution 
of the thermal noise, P(£), induces a time-dependent probability distribution of the 
dynamic variables q and v (or p — v/M): 

P(q,v,t) = Jv^P(0S(q-qf(t))5(v-vf(t)) . (6.1) 



29 



that satisfies the Kramers equation 



7 



dP(q,v,t) 
dt 



-- {vP{q , v , t )) + - 



v + 



V'(q) , 7 fc B T 9 



M 



+ 



P(g,u,f) 



(6.2) 



For colored noises one cannot derive a simple differential equation for P(q,v,t); 
indeed, it is clear that in these cases the stochastic process is not Markovian. The 
averages over thermal histories can be expressed in terms of P(q, v, t), (A[q, v])(t) = 
JVqVvP(q,v,t)A[q,v}. 

When the inertial term in the Langevin equation can be dropped, P(q, v, t) is 
replaced by an exclusive function of q, P(q,t), defined as 



P(q,t) = Jv^P(05(q-qf(t)) 

and determined by the Fokker-Planck equation, 
dP(q,t) 



7- 



dt 



§- q [P(q,t)V\q)]+k B T^P(q,t). 



(6.3) 



(6.4) 



It is very important to note that the balancing of factors on the right-hand-side 
(rhs) of the Fokker-Planck and the Kramers equations is a direct consequence of 
the equilibration of the noise (see Appendix A). This relation is known under the 
name of Einstein relation or fluctuation - dissipation theorem of the second kind 
(according to Kubo). We shall see its implications below. 



6.2 Approach to equilibrium 

In this Section we focus, for simplicity, on the Fokker-Plack equation (6.4). In order 
to ensure the equilibration of the system at long times P GB must be a stationary 
solution of the Fokker-Planck equation. Introducing P oc exp(— j3V) in Eq. (6.4) 
one realizes that any other ratio between the factors in front of the first and second 
term on the RHS of the Fokker-Planck equation would not allow for this asymptotic 
solution. 

We still have to show that P GB is the actual asymptotic solution reached by the 
dynamic process, lim^oo P(t) = P GB . An easy and elegant proof relies on a mapping 
between the Fokker-Planck and the Schrodinger equations [68]. Introducing 

P(q, t) = MQ)P(Q, t) = c p(q, t) (6.5) 

with c a positive constant, one has 

p(q,t) = H FP p(q,t) . (6.6) 

This is a Schrodinger equation in imaginary time. Note however that p(q, t) here is 
a probability density and plays the role of a wave function while in true quantum 
mechanics it is the modulus squared of the wave function which has a probability 



7- 



dp(q, t) 
dt 



dq 2 



\v"{q) + ^{V'{q)f 
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interpretation. If the term between square brackets grows to infinity sufficiently fast 
when q — > ±00 the spectrum of the Fokker-Planck Hamiltonian H FP is discrete. It is 
now easy to check that ipo(q) is the ground state of H FP , i.e. a positive definite eigen- 
vector with eigenvalue E = 0. We write p(q, t) = J2 n Cnipniq) exp(— E n t) with if) n (q) 
the eigenvector associated to the eigenvalue E n , E n > when n > 0. When t — > 00 
all terms vanish apart from the one with n — 0, lim t ^ 00 p(g, t) = Coipo(q) = ipo(o), 
where we used Co = / dqtpo(q)p(q,0) = J dqP(q,0) = 1. This expression implies 
lim^oo P(g, t) = ipl(q) = c 2 exp(— and the conservation of probability allows 
one to compute the normalization constant, c -2 = / dq exp(— /3V(q)). Thus P GB is 
indeed the asymptotic solution to the Fokker-Planck equation [68]. 

Note that this argument assumes that a sufficiently long t (t > t m ) is reached 
such that only the n = term survives in the sum. This hypothesis does not 
hold in the asymptotic analysis for the relaxing models we analyze in the next 
Sections. In the low-T phase the equilibration time grows with the size of the 
system, t EQ (N) — > 00, while in the analysis we only consider times that are finite 
with respect to N. Moreover, when non-potential or time-dependent forces are 
exerted on the system, see Eq. (4.9), the transformation (6.5) is not sufficient to 
deal with their effect and equilibrium cannot be established. 

Just as in usual quantum mechanics one can use an operator notation to represent 
the Fokker-Planck equation. Indeed, identifying —id/dq with the operator p the 
usual commutation relations between momentum and coordinate are recovered. The 
probability distribution P(q, t) is then identified with a quantum time-dependent 
"state" \P(t)). With these new names, the Fokker-Planck equation reads 

7^P = #fp|P(*)) with H ¥P = p (iV'(q) - k B Tp) . (6.7) 

\P(t)} is obtained from the evolution of an initial state |P(0)) with the operator 
exp(— H FP t). 

6.3 Equilibrium dynamics 

All average values (5.2) can be computed using P(q, t) as (A[q](t)} = J dq A[q] P(q, t). 
If we pursue the identification with the quantum mechanics formulation and we as- 
sociate the bra (— | to the "wave function" identical to 1 we write the average as 
(A[q](t)) = (—\A[q]\P(t)). The normalization of the probability distribution reads 
(—\P(t)) = 1. Clearly, if the system reached equilibrium at a time t', all averages of 
one-time quantities are time-independent henceforth. 

Any correlation CAB(t,t') for two "local" functions of the variable q can be 
expressed as 

C AB (t,t') = fdqfdq'J dq" A[q]T{q',t' - q, t) B[q'\ T(q", - q',t') P(q",0) 
= (-1 A[q] exp(-# FP (t - 0) B[q] exp(-H FP t') |P(0)> . (6.8) 

In the transition probabilities, T, we included the time-dependence to clarify their 
meaning. In the second line we used the quantum mechanical notation. If the time 
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t' is longer than the equilibration time, the probability density at t' reached the 
equilibrium one, Jdq"T(q",0 -> q',t') P(q",0) = P GB (q'). Equivalently, \P(t')) = 
\P GB ). Two properties follow immediately: 

Stationarity: Since the transition probability is a function of the time- difference 
only, T(q,t;q',t') = T(q,q';t — t') = (q\ exp(— H FP (t — t'))\q') the correlation is 
invariant under translations of time for t' > t EQ . 

Onsager relations: (A[q](t)B[q](t')) = (A[q](t')B[q](t)) for any two observables 
A and B that depend only on the coordinates. Indeed, 

(A(t')B(t)) = {-\Be-^(t-t')A\P GB } = (P GB |it( e - Ap( *-*' ) ) t S t |-) 

= {P w \Ae- 6 ^-^B\-) = {-\e-&Ae-"»WBe<*e-<*\-) 



GB/ 



(6.9) 



The proof is completed by showing that e -/3^ e -^Fp(*-t') e /3^ — e -H FP (t-t') f or a jj t _ f 
which is equivalent to H% p = e^ v H FP e~^ v . The latter can be checked directly using 
the Fokker-Planck Hamiltonian. The matrix elements (q\e~ HFFT \q') = T(q',t — > 
q,t + r) and (q\e~^ pT \q') = T(q, t — > q',t + r) yield the transition probabilities and 
the first equation in this paragraph can be recast as T(q', t — > q, t + r) e~P y( < q ) = 
T(g, i — > q',t + r) e~^ v ^ which is detailed balance. 

Similarly, one proves that the linear response RAB(t,t') is also stationary when 
P(q',t') = P GB (q'). We represent the instantaneous infinitesimal perturbation h(t') 
as the kick between t a — 5/2 and t a + 5/2 in Fig. 8-left. The Fokker-Planck Hamil- 



tonian in the presence of the field is H p 



ip 



V'(q) + hB'[q] + k B Tip 



while H FP is 



the Fokker-Planck operator in no field. The average in a field reads 

(A[q]) h (t) = (-| A[q] e-M^'-f) e -&[(« +*)-(* -i)] e -M*-i) |P(0)> . (6.10) 
and the variation with respect to h yields 



Ah B (t') 



(-| A[q] e -^(*-*'-f) (^- 6 Ek_Ell)j e -MM) |P(0))(6.11) 



with A/i = h5. The factor between parenthesis equals (— ipB'[q]h5) / (h5) = —ipB'[q\. 
Taking the limit 5^0 and evaluating at h — one has 

iWM') = H%] exp [-# FP (*-*')] {-ipB'[q\) exp(-H FP t') |P(0)) . (6.12) 

From this expression one recovers several properties of the response: 
Causality: The same derivation for t' > t yields 

R AB (t,t f ) = (-| (-ipB'[q\) exp [-H FP (t - t')] A[q] exp [-H FP f] \P(0)) . (6.13) 

Since (-\p = 0, R(t,t') = for all t < t' . 

Stationarity: When exp (^—H FP t'^j \P(0)) = \P GB ) one has 



R AB (t,t') = (-\ A[q] exp -H FP (t-t') {-ipB'[q\) \P t 



GD/ 



(6.14) 
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A'[q]B'[q} exp 

-Rab(M') -- 



Response at equal times: \im t r__> t - /?ab(M') = (- 

If A[q] = B[q] = q then A'[q] = B'[q] = 1 and lim t ,_ 
from conservation of probability. 

Fluctuation- dissipation theorem: We postpone its discussion to Section 7.2. 

Onsager relations: Using the relation between correlation and responses dictated 
by the fdt one finds that the Onsager relations must also hold between responses. 



7 The fluctuation - dissipation theorem (fdt) 

The fluctuation-dissipation theorem (fdt) relates the correlations of spontaneous 
fluctuations to the induced fluctuations in equilibrium. It is a model independent 
relation between the linear response and its associated correlation function that 
takes different forms for classical and quantum system. The latter reduces to the 
former when quantum fluctuations become irrelevant. In this Section we present 
several proofs of the fdt. When the equilibration hypothesis is not justified, this 
relation does not necessarily holds. 



7.1 Static fdt 

Many relations between correlations of fluctuations and susceptibilities are known 
in statistical mechanics. All these are different statements of the static fdt. 

Take for instance a perfect gas. The fluctuations in the density p = n/V where 
n is the number of particles within a sub volume V of a system with N particles 
and volume V, are defined as: a 1 = ((p — (p)) 2 ). In the thermodynamic limit iV — > 
oo, V — > oo with N/V = p fixed, these are related to the isothermal compressibility 
Xt = —l/VdV/dP\ T via a 2 p = (k B T)p 2 XT/V. This relation is a form of fdt. 

For a system in equilibrium with a thermal reservoir at temperature T one has 

= P({A-{A)f) (7.1) 

h=0 

for any observable A. The average ( )h is calculated with the partition function 
of the system in the presence of a small field coupled to A in such a way that the 
Hamiltonian reads H = H — hA. For a magnetic system this equation relates the 
magnetic susceptibility to the magnetization fluctuations. 



S(A) h 
5h 



7.2 Dynamic FDT 

There are several proofs of this theorem. Here we focus on a Fokker-Planck process. 
In Section 6.3 we computed Rab and Cab m equilibrium. Taking the derivative of 
Eq. (6.8) with respect to t' one finds 

dCAB Q t r t,] = (-\A[q}eM-HMt-m-ipk B TB'[ q ])\P GB ) 

= k B TR AB {t-t') (7.2) 
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for t — t' > 0. Note that since in equilibrium the averages of one-time quantities 
are constant one can replace Cab(^ — t') by the connected correlation C c AB (t — 
t') = C AB {t - t') - (A)(B) in the left-hand-side (lhs) and the fdt also reads 
dt'C l X B (t - t') = k B TR AB (t - t'). In integrated form 

k B T X A B {t - t w ) = Cab (t - t) - Cab (t - t w ) = C c AB {t - t) - C c AB (t - t w ) . (7.3) 

7.3 Quantum FDT 

Proofs and descriptions of the quantum fdt can be found in several textbooks [70, 
68]. Here, we express it in the time-domain and in a mixed time- Fourier notation 
that gives us insight as to how to extend it to the case of glassy non-equilibrium 
dynamics. 

If at time t' a quantum system has reached equilibrium the density operator pit 1 ) 
is just the Boltzmann factor exp(—3H)/Z. As in Section 6.3 it is then immediate 
to show that time-translation invariance (tti) holds C AB {t,t') = C AB (t — t'). In 
addition, from the definition of Cab (t, t') in Eq. (5.11) one proves the kms properties 
C AB (t,t f ) = C BA (t',t + i(3H) = C BA (—t — i(3H, —f). Assuming, for definiteness, that 
t > it is easy to verify the following equation 

C { A,B}(r) + jRab(t) = C {A , By (r*) - ^Rab(t*) , (7.4) 

where r = t + i[3h/2. This is a way to express fdt through an analytic continuation 
to complex times. In terms of the Fourier transformed Cab{^) defined in Eq. (5.7) 
the kms properties read C AB {u) = exp(/3fuj)CBA(—u) and lead to the following 
relation between Fourier transforms of symmetrized and anti - symmetrized corre- 
lations: C[a,b](w) — tanh C{a,b}{w). Using now the Kubo relation (5.13) one 
obtains the quantum fdt 

R AB (t -t') = % - ^ exp(-iw(* - 0) tanh (^^J C {a ,b}(ou) , (7.5) 

t > t'. With the representation J °° dt exp(iujt) = lim 5 __ >0 + i/(u+i5) = n5(uj)+iP/uj, 

Rab(u) = -- Urn / — — tanh ) C {a ,b } ^ 7-6) 

from which we obtain the real and imaginary relations between Imi2AB(a;), Rei?AB(^) 
and C{a,b}(u). If dhuj/2 < 1, tanh(/3/icj/2) ~ dhu/2 and Eq. (7.5) becomes the 
classical fdt, Eq. (7.2). 

7.4 Examples 

7.4.1 Harmonic oscillator and diffusion 

The simplest example in which one sees the modifications of the fdt at work is a 
one-dimensional harmonic oscillator with no inertia coupled to a white bath. One 
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finds 



k B T 



dvC(t,t') 



R{t,t') 



1 + exp 



2kf 
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) 




1 if k > 
\ if k = 
if k < 



(7.7) 



for times t > t f and t f ^> ^y/k with the harmonic constant of the oscillator. Thus, 
when there is a confining potential and P GB can be defined the fdt holds. Instead, 
when the potential is flat (k = 0) or unbounded from below (k < 0) no normalizable 
P GB can be defined and the fdt is modified. 

If one keeps inertia, the calculations are slightly more involved but one can carry 
them through to show that momenta and coordinates behave very differently [71]. 
Since the probability distribution of the momenta very rapidly reaches a Maxwellian 
for all values of k these variables equilibrate and fdt holds for them. This is the 
reason why the kinetic energy of a particle system serves to callibrate the external 
temperature. The coordinates, instead, behave as in (7.7) depending on the value 
of k. 

7.4.2 A driven system 

Take now a symmetric two-dimensional harmonic oscillator V(x, y) = k/2(x 2 + y 2 ) 
and apply the non-potential force f(x,y) = a(y,—x) on it. This force makes a 
particle turn within the potential well and one can check, by direct calculation, that 
the fdt does not hold. 

7.4.3 No Einstein relation 

If the bath is such that the Einstein relation between friction and noise correlation 
does not hold, the fdt for the system variables does not hold either. Again, this 
can be easily checked using a harmonic oscillator. 

7.4.4 A complex bath 

Let us couple a harmonic oscillator to a complex bath made of two parts: a white 
bath (tc(i) — > 0) with friction coefficient 71 at temperature T"i and a coloured bath 
with friction kernel ^{t — t') = 7 2 exp[— (t — £')/ r £( 2 )] kept at temperature T 2 [72]. The 
complex bath induces two time-scales (see Section 11.4 for its precise definition) in 
the dynamics of the oscillator: the correlation is stationary but it decays in two steps, 
from q d at equal times to an "Edwards- Anderson parameter" q EA for time- differences, 
r, that are shorter than a characteristic time r and from q EA to zero for longer r's. 
The parameters q^, q E A an d r are functions of k, the friction coefficients 71 and 72 
and the two temperatures Ti and T 2 . In Fig. 9 we display the correlation decay and 
the parametric plot of the integrated linear response, x, against the correlation, C, 
constructed using t — t' as a parameter that runs from t — t' = (C = qd, X — 0) 
to t — t' — > 00 (C — > 0, x = x)- (See Section 11.5.3.) The fdt predicts a linear 
relation between x and C w hh a slope —l/(k B T) for systems equilibrated with a 
reservoir at temperature T. In this problem though "there is no T" since the system 
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Figure 9: Left: Decay of the correlation for a harmonic oscillator coupled to a 
mixed bath. Right: paramteric plot of the integrated linear response against the 
correlation. 



is coupled to a bath with two temperatures and two time-scales. Surprisingly, one 
finds that the rapid decay is controlled by the temperature of the fast bath, T 1; while 
the subsequent, slower, decay is controlled by the temperature of the slow bath, T 2 . 

A similar phenomenon, now self-induced, appears in glassy models. These in- 
teracting systems are coupled to an external white bath at temperature T\. Their 
dynamics is such that several time-scales, each with its own "temperature" is gen- 
erated. We shall show how this arises in solvable models in Section 12 and we shall 
prove that the FD relation can indeed be used to define an "effective temperature" 
in Section 14. 



8 Dynamic generating functionals 

In this Section we present the functional methods used to analyze the dynamics 
of classical [73] and quantum [74] models coupled to environments. We discuss the 
relation between the two approaches. The generating functionals, with their effective 
actions, are the adequate starting point to apply perturbation theory (when it is 
accepted), self-consistent approximations such as the mode-coupling approach, or 
even more sophisticated techniques as the functional renormalization group. 

8.1 Classical models 

For a classical system coupled to a classical environment, we use as a starting point 
a stochastic equation with an additive noise £(t) = EQ(g). For instance, if we 
deal with a massive particle governed by the Langevin equation, Eq. (4.7) EQ(g) = 
Mq + f*df^t-t')q(f)+V'(q). ^ 

Any averaged observable, e.g. (A[q])(t) in Eq. (5.2), can be computed from the 
variation of a dynamic generating functional Z with respect to a time-dependent 
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source 77: 



(A[q])(t) = 



SZ[rj] 



5 V (t) 



v(t)=o 



£>£ p[£] e J dt ' r,(t')A[qf]{t' 



(8.1) 



r;(t)=0 



JVq5{q-qf)= J Vq 6(£ - Eq[q]) 



det 



(8.2) 



Since the probability distribution P[£] is normalized to one, Z[r) = 0] = 1, and the 
average is automatically normalized. The idea is to derive a useful expression for 
the generating functional Z by introducing the functional identity 

( SEQ[q](t) \ 
{ Sq(t') ) 

In the first integral an integration and delta function is applied on each time slice 
and the compact notation actually represents / I\ a [dq(ci)5(q(a) — q^ ol (a))]. The sec- 
ond identity follows from a change of variables in the functional integral. If the 
stochastic equation has only one solution, one can eliminate the absolute value in 
the determinant, and 

Z[n\ = J VtVqP[$5(t-EQ[q}) det ( ^[^ ) exp (J dt' V (t')A[q](t'^ . (8.3) 

This expression can be recast in a more convenient form by using the exponential 
representation of the delta function 

rt 



6(Z - EQ[q]) oc J Viq exp [- jf dt' iq(t') (£(*') - Eq[q](t')) 



•4) 



(the constant of proportionality is numeric, a power of 2n, and irrelevant for the cal- 
culation of averages, thus we omit it), and the determinant through the introduction 
of a pair of fermionic variables [65] 



det 



( SEQ[q](t) \ 
[ Sq(t') ) 



UipVip exp 



dt' 



t - 5EQ[q](t') „ 



(8.5) 



Having used these identities, the generating functional becomes a functional integral 
over £,q,iq, ip and ip. Since £ appears in quadratic terms of the effective action only, 
the functional integral over £ can be simply calculated. We obtain 



ZiViV] — J 'DqViqDifj'DiJj exp(— S EFF ) 



dt' / dt" -iq(t')k B T9(t' - t"W - t")iq(t") 



5q(t") 



fdt' (iq(f) E Q [q](t') - V (t')q(t') - f,{t')iq{t')) 
Jo 



(8.6) 



where we have introduced a new source rj(t) coupled to the auxiliary variable iq(t). 
In Appendix C we prove the following very useful relations 

R(t,t') = (q(t)iq(t')) (8.7) 

\k B T fdt" W,t")+7(t",t'))R(t,t") = (q(t)ffl). (8.8) 
I Jo 

Usually, the kernel ^(t',t") is symmetric "y(t',t") = j(t",t') and the latter relation 
simplifies. For a white noise -f{t',t") = 2^5{t' - 1") and 2~fk B TR(t,t') = (q(t)£(t)). 
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8.2 Supersymmetry (SUSY) 

In the white noise limit Z in Eq. (8.6) can be written in a much more compact 
form if one introduces the super-field formulation of stochastic processes explained 
in [65, 76, 77], see Appendix D. One first enlarges (space)-time to include two 
Grassmann coordinates 9 and 6, i.e. t — > a — (t,9,9). The dynamic variable q(t) 
and the auxiliary variable iq(t) together with the fermionic ones ip(t) and ip(t) are 
encoded in a super-field, 

$(a) = q(t) + 6iP(t) + ^(t)9 + iq(t)99 . (8.9) 

With these definitions, 

Z[rj\ = J d$exp (-^ J da $(a)(-£>( 2 >)$(a) - J da V[Q{a)\ + J da<f>(a)rj(a) 

(8.10) 

with a = (t, 9, 9), da = dtd9d9, and the dynamic operator defined as 

- Di *> - 2 ^ T ms + ^am ~ ~ ut nsm ■ (8 ' n) 

If the model is spherically constrained, —D^ — > —D^ — ^(a) with 11(a) a super 
Lagrange multiplier introduced to enforce the constraint. The delta function 8(a — b) 
is defined in Appendix D and it satisfies / dbS(a — b)f(b) = f(a). The super- 
symmetric notation allows one to encode in the single super correlator Q(a, b) = 
($(a)$(6)) all correlators and responses. The generalization to a system with iV 
degrees of freedom is immediate. 

Symmetries 

The properties of the equilibrium dynamics, i.e. the invariance under time- 
translations, the fluctuation-dissipation theorem, etc., are consequences of the sym- 
metries of the super-symmetric action. The non-equilibrium dynamic solution spon- 
taneously breaks these symmetries. 

For a stochastic process with a white noise the SUSY group is generated by three 
operators [76, 65, 77]: 

D' = -fkeTde + 9-fdt D' = d§ D'D' + D'D = jd t (8.12) 

with D' 2 = D' 2 = 0. We can construct an extension of this group that acts on 
two-point (in general n-point) functions, as 

D'(a, b) = D'(a) + D'(b) D'(a, b) = D'(a) + D'(b) 

~D'(a,b),D'(a,b)] + = d t + d t ,. (8.13) 

The meaning of the three generators can be understood when they are made to 
act on Q(a, b). Firstly, causality plus probability conservation imply (irrespective of 
equilibration): D'(a,b)Q(a,b) = 0, This equation serves to select the non-vanishing 
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terms in the super correlator. It imposes (iq(t)iq(t')) = and the fact that all 
components involving only one ip and ip vanish. Then 

Q(a, b) = C(t, t') - - 9) {9'R(t, t') - 9R(t', t)) (8.14) 

(the bifermionic correlator (ip(t)ip(t')) equals the response R(t, t')). The SUSY action 
[the exponent in Eq. (8.10)] vanishes if evaluated on such correlators (when r] = fj = 
0). The other two generators imply 

(d t + d v ) Q(a, b) = -> tti , D'(a, b)Q(a, b) = -> fdt . (8.15) 

When is a system unable to reach equilibrium? In terms of symmetries this 
question can be addressed as follows. In driven system the dynamical actions break 
SUSY explicitly. They are externally kept far from equilibrium by the forcing. If SUSY 
is not explicitly broken two possibilities arise. Either the system evolves from its 
initial condition during an out of equilibrium transient in which neither stationarity 
nor fdt hold until the equilibration time t m is reached and equilibrium establishes. 
In this language, SUSY is unbroken by the boundary conditions. On the contrary, 
if the system never achieves equilibrium the equilibration time diverges and cannot 
be reached in the calculation. The effect of the initial conditions is then to break 
SUSY [77, 78] and consequently violate the equilibrium properties even for long times. 
SUSY is then spontaneously broken. The initial conditions play for SUSY the same 
role played in ordinary symmetry-breaking by space boundary conditions: if the 
symmetry is spontaneously broken their effect extends away from them, in this case 
for all times. 

8.3 Connection with the replica formalism 

The effective action in Eq. (8.10) is a kinetic minus a potential term V[<&]. When 
applying the replica trick to compute the free-energy a replicated effective potential 
V[(p a ] appears. A connection between the two formalism, that is based on the similar- 
ity between the zero- dimensional replica space and the SUSY one, has been exploited. 
Roughly speaking, many properties of the replica overlap Q ab = iV _1 X)£Li. (s"sf) 
finds a counteraprt in the dynamic SUSY correlator Q(a, b). For instance, a summa- 
tion over a replica index, J2a=i when n — > 0, translates into an integration over the 
supercoordinate / da. For the moment, though, the connection is empirical and a 
formalization of the relation between the two approaches would be welcome. 

8.4 Quantum models 

The Schwinger-Keldysh formalism [74] allows one to analyze the real-time dynamics 
of a quantum system. The starting point is the time dependent density operator 

PtotW = e-^ TOT * p TOT (0) _ (g_ 16 ) 

Introducing identities, an element of the time-dependent density matrix reads 

/oo . - 

dQdQ'dX a dX' a e~n H ^ \Q,X a ) 

-oo 

x(Q,X a \ p TOT (0) \Q',X' a )(Q',X' a \ e^™ T * \q',x' a ) , (8.17) 



39 



where q is the coordinate of the particle and x a are the coordinates of the oscillators. 
The first factor is the coordinate representation of the evolution operator and it can 
be represented as a functional integral. The third factor can also be represented in 
functional form. They read 



Q +u\— Q n r x + (t)=x" 

tfX\e-t*««<\Q,X a ) = 'Vxt(t)e^ (8.18) 

Jq+(0)=Q Jx+(0)=X a 

(Q',X' a \e^\ q >,x> a ) = r it)=9 ' Vq-(t) r {t)=X ' a Vx-(t)e-^ .(8.19) 

Jo-(0)=Q' Jx-(0)=X'„ 



lq+(0)=Q Jx+(0)=X a 

Vq~{t) / 

-(0)=Q' Jx-(0)=X' a 

Interestingly enough, the evolution operator in Eq. (8.19) gives rise to a path integral 
going backwards in time, from q~(t) = q',x~(t) = x' a to q~(0) = Q',x~(0) = X' a . 
The full time-integration can then be interpreted as being closed, going forwards 
from to — to t and then backwards from t to to = 0. This motivates the name 
"closed time path formalism". A doubling of degrees of freedom (q + ,q~) appeared 
and it is intimately linked to the introduction of Lagrange multipliers in the func- 
tional representation of the stochastic dynamics in the classical limit. 

The action S^ot has the usual four contributions, from the system, the reservoir, 
the interaction and the counter-term. The action of the system reads 

2 



sL.[q + (t),v + (t)} = I dt' 

Jo 




-V(q + (t'))+r) + (t')q + (t') 



(8.20) 



where we have introduced a time- dependent source i] + {t). Similarly, we introduce a 
source r]~(t) in the path integral going backwards in time. 

Since we are interested in the dynamics of the system under the effect of the 
reservoir we compute the reduced density matrix 

/CO 
dx a (q", x a \ p TOT (t) \q', x a ) . (8.21) 
-oo 

The initial density operator p TOT (0) has the information about the initial state 
of the whole system. If one assumes that the system and the bath are set in contact 
at t = 0, Ptot(0) factorizes /3 T ot(0) — Psyst(0)/3 E nv(0). (Other initial preparations, 
where the factorization does not hold, can also be considered and may be more re- 
alistic in certain cases.) If the environment is initially in equilibrium at an inverse 
temperature f3, /) E nv(0) = Z~^ v exp(—(3H Bm ). For a bath made of harmonic oscilla- 
tors the dependence on the bath variables is quadratic and they can be traced away 
to yield: 



roo rco r<l + (t)=q" rq (t)=q' t „ 

Pred(<7"; q'; t)= dQ dQ' / Vq+ / Vq-en s ^(Q\ p SYST (0) \Q') 

J-oo J-oo Ja+(0)=Q Ja-(0)=Q' 



/ Vq+ \ 

>q+{0)=Q V(0)= 

with S EFF = S^y ST — S^ YST + S Tli . The last term has been generated by the interaction 
with the environment and it reads 

S m = -f*dt>J*dt" {q+(t')-q-(t'))r](t'-t") (q + (t") + q-(t")) 

+ij*dt'J* dt" (q+( t ')-q-(t')) v(t'-t") (V \t") - q~ (*")) .(8.22) 
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The noise and dissipative kernels v and rj are given by 

u(t) = J dwl(u) coth (^phu?j cos(u(t)) , 



T)(t) = 9(t) 



dl(t) 
dt 



/•OO 

-6(t) / du I (a) sin(w(*)) . 
Jo 



(8.23) 
(8.24) 



In these equations, I(u>) is the spectral density of the bath, already defined in 
Eq. (4.6). 7 is defined in the first identity and as we shall see below it plays the 
same role as the friction kernel in classical problems with colored noise. 

Next, we have to choose an initial density matrix for the system. One natural 
choice, having in mind the quenching experiments usually performed in classical 
systems, is the diagonal matrix (Q\ p SY s T (0) \Q') = 5{Q — Q') that corresponds to a 
random "high-temperature" situation and that allows one to simplify considerably 



Pred : 



p RED (q";q';t) 



fq+{t)=q" f q-(t)=q' 4 

dQ / Vq + (t) / Vq- (t e^ EFF 

A+(o)=Q Jq-(P)=Q 



Another representation of p RED is obtained by renaming the variables 



Q = 7>( q+ + q ) 



n = -q ) ■ 



(8.25) 



.26) 



and rewriting the effective action as a function of q and iq. The new form is useful to 
establish contact with the generating functional for classical systems. The thermal 
part simply becomes 

S TH = - f dt' f dt" hiq(t') r)(t' - t") 2q(t") + i C dt! f dt" Hiq(t') u(t' - t") Mq(t") 
Jo Jo Jo Jo 

as for a Langevin process in a colored noise. When h — > 0, the full effective action 
approaches the classical one as can be verified by expanding in powers of H, and 
keeping only the leading terms. If, moreover, the limit A — > oo is taken, the kernels 
7 and v become proportional to 5 functions and one recovers a white noise. Keeping 
h > the rotated version allows one to treat classical and quantum problems in 
parallel. 

If one generalizes the above system to be one described by a field 0j with i = 



1,N components, the symmetrized correlation function Cij(t,t') 
4>j(t')4>i(i)) (where the hats represent operators) is given by 



Cij(t,t') — 



2 r 



5 2 



+ 



6 V t(t)5r)-(t>) ^+(t')H r W 



MM?) + 



(8.27) 



ri=0 



[Cij(t,t') = Cji(t',t)]. Using the Kubo formula (5.13) the linear response func- 
tion can be expressed in terms of the averaged commutator, Rij(t,t') = i/H9(t — 

t')([Ut),Ut')\) and 



Rij(t, t) 



h 

i 



5 2 



5 V t(t)5 V +(t>: 



+ 



s 2 



8 V nt)5 V -(t>) 



Pred 



(8.28) 



r?=0 
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(The hats represent operators.) It is also useful to write the correlation and response 
in terms of the fields (fif, (f>~ and their rotated counterparts 



2C^(m') = <0+W07(O + = (MtM?) + MVHt)) , (8.29) 



8.5 Average over disorder 

In general one is interested in the evolution of a model in which the configuration 
of disorder is typical. One could either attempt to solve the dynamics for one such 
disorder realization or one can assume that the behavior of a typical system is de- 
scribed by the averaged behavior over all systems, each weighted with its probability. 
Since the former procedure is more difficult than the latter one usually studies the 
dynamics averaged over disorder and computes: 



J represents here the random exchanges in Eq. (2.5). Similarly, one can perform an 
average over a random potential in a problem as the one defined in Eq. (2.8). 

One of the advantages of using a dynamic formalism is that when the initial 
conditions are uncorrelated with disorder there is no need to use the replica trick to 
average over disorder [75]. Indeed, the classical generating functional is constructed 
from a path integral that is identical to 1 (and hence independent of disorder) in the 
absence of sources. The same holds for the quantum Schwinger-Keldysh generating 
functional, Trp RED (0) = 1, since we have chosen a diagonal density matrix as the 
initial condition for the system. Thus, 



and these averages can be simply computed from [Zj] [79]. 

If the initial condition is correlated with the random exchanges or the random 
potential, the situation is different. One such example is the study of the equi- 
librium dynamics of a disordered model, i.e. the study of the evolution of initial 
conditions taken from P GB . In this case, the use of replicas to average InZ is un- 
avoidable and one is forced to treat replicated dynamic correlators. For classical 
models this has been discussed in [80]. For quantum problems the difficulty of the 
calculation increases since one needs to work in a mixed real and imaginary time 
formalism [81]. The initial density operator is a Boltzmann factor that is repre- 
sented with the Matsubara formalism while the real-time dynamics is written with 
the Schwinger-Keldysh approach. Mixed correlators and responses intervene in the 
dynamic equations. 



Rlj (t,t>) = l - {<t>t{t) o+(o - 0-(o)> = m) iUf)) ■ 



(8.30) 



J dJP(J) J V(j)Vi(f) A[<j>, ij>] e - 5 -d^] 
/ dJP(J) JV(j)J Vi0 e-S^fe.^ 



(8.31) 




(8.32) 
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9 Dynamic equations 



In this Section we present three derivations of the dynamic equations for the macro- 
scopic order parameters that use the classical or quantum dynamic generating func- 
tional as starting points. Each method is better adapted for different kinds of 
models. 



9.1 A useful derivation for fully-connected models 
9.1.1 Classical systems 

Even if the use of the SUSY notation is not necessary to derive the dynamic equa- 
tions [82], it is very useful in several aspects. Firstly, it allows to establish contact 
with the replicated version of the static partition function and the further study of 
this quantity; secondly, it is very useful as a bookkeeping tool; thirdly, it allows us 
to develop more sophisticated techniques amenable to derive the dynamic equations 
of models without fully connected interactions. For all these reasons, we preferred 
to introduce the SUSY formalism in Section 8.2 and use it here. 

Since for classical models the use of white noises is rather generally justified we 
shall stick to this case. Moreover, we shall drop the inertial contribution to further 
simplify the presentation. We analyze here models with N variables <fi = (0i, . . . , 4>n) 
of the kind discussed in Section 2. In SUSY notation the dynamical generating 
functional after setting the sources to zero reads 



Z = J V<$> exp [- f da $,(a) (-£><?> - p,(a)) ^(a) + V[$] ) (9.1) 



with $ and fj, a two super-fields, the latter imposing the spherical constraint (/i s (a) = 
Hit) + fermionic + fi(t)99, p,(t) is a Lagrange multiplier that fixes the measure of 
integration and /i(t) enters the Langevin equation). Soft spins with their corre- 
sponding potential energy can be studied in a similar way though their treatment is 
slightly more complicated. The potential energy of a rather generic fully connected 
disordered model can be expressed as a series expansion of the form 

oo 

V[*] =gJ2 F r E J u-v +1 *u • • ■ *wi » ( 9 - 2 ) 

r>0 ii<...<i r +i 

For each r the sum is taken over all possible groups of r + 1 spins. The fully- 
connected character of the model implies that there is no notion of distance or 
geometry. Ji 1 ...i r+1 are random interactions taken from a Gaussian distribution with 
zero mean and variance [J? ir J = (r+ l)!/(2iV r ), just as in the model in Eq. (2.6) 
Thus (9.2) is a Gaussian random potential with 
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The scalar product in the second member is defined as $(a) • $(b) = E? &i(a)&i(b). 
The bullet means that the powers are taken locally in the super-coordinates a and 
b and they do not involve an operational product, see Appendix D. The term 
r = corresponds to a random field linearly coupled to the spin, the term r = 1 
is quadratic in the fields while for r > 2 we obtain higher order interactions. If 
F r = F p 7^ 0,p > 2 and all other F r = one recovers a spherical p spin model. If 
two parameters are non-zero one obtains a model with two p spin terms. The model 
of a particle in an infinite dimensional spherical random environment correlated as 
in (2.8) also falls in this category if one can expand the correlator in a power series. 
The disordered averaged generating functional reads 



* i(o ) (-D< 2) -Mo)) **(«)+$/ dadb V (^®) 



(9.4) 



Introducing the order parameter Q(a,b) = N 1 E^Li ®i(a)®i(b) through 



1 oc J pg^Q e ^5/ dadb (^ ( 3( a ' b ) ( 3( a ' fe )- i( 3( a ' b )E!Ii <I> *( a ) <I> »( 6 )) (9.5) 



yields 



V^VQViQ exp 



-- [ dadb (NiQ(a,b)Q(a,b)-NV(Q(a,b)) 



N 



- ]T $,(a) (-.Of - ^(a)) 5(a - 6) - iQ(a, 6)) Mb) 



i=i 



(9.6) 



(Again we omit irrelevant normalization constants.) Note that all terms in the 
exponent are order iV if the integrals yield finite contributions. We call the models 
for which this is true "mean-field" since the saddle-point evaluation of the integral 
when iV — > oo is exact without including fluctuations. There is however a caveat in 
this reasoning that we discuss in Section 9.4. 

The saddle-point values for the Landau fields Q are simply related to correlations 
of the original spins. Indeed, evaluating the generating function in Eq. (9.6) with a 
saddle-point approximation 



= 



SS 



8iQ(a, b) 



N 



NQ SP (a,b) = J2(Ma)Mb)) 



i=i 



Z[Q\ ' 



(9.7) 



where the average on the RHS is taken with the generating functional 

Z[Q\ = J V<S>VQ e /^4[E,^i**( a )(- £ '- 2) -A 1 «(a))«(<»-6)*i(6)+JVV*(Q(a,6))j ^ g g ^ 

Opening up the SUSY notation Eq. (9.7) implies, as expected, 

N N 

NC BP (t 1 ,t 2 ) = J2(qi(ti)qi(t 2 ))z[Q] , NQ SP (t 1 ,t 2 ) = J2(iqi(h)iqi(t 2 )) z [Q ] 
i=i i=i 

N N 

NR SP (t!,t 2 ) = 5Z(ft(*0 i ft(*2))i[Q] > NRl P (t!,t 2 ) = ^2{iqi(ti)qi{t 2 ))z[Q] ■ 



i=i 
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Going back to Eq. (9.6) we can now shift iQ, Q = (—D^—fi(t)) 5(a—b)—iQ(a,b), 
and integrate over $j 

\ z \ = Jx>QVQ I dadb [Q( a > b W a 'V + (- D ° ) -^ t » s ( a -V Q(a,b)-V(Q(a,b))^ e _^TrLno 

Using a saddle-point evaluation, we eliminate Q, [Z] = J VQ exp[— NS EFF (Q)], 

2S EFF (Q) = J dadb [[-D {2) - n 8 (a)]5(a - b) Q(a, b) - V(Q(a, b))] - TrLn Q . (9.9) 

The saddle-point equation over Q, 5S FFF /5Q = 0, yields the dynamic equation 

(D™ + n(t))8(a -b) + Q-\a, b) + V"(Q(a, b)) = , (9.10) 
that takes a more convenient form after multiplying operationally by Q: 

{D {2) + /i(t))Q(a, b) + 5(a-b) + J da' £(a, a')Q(a', b) = , (9.11) 

with the self-energy defined as 

oo 

£(a, b) = V'(Q(a, b)) =g 2 Y, F 2 {r + l)Q(a, b)' r . (9.12) 

r>0 

We have recasted the saddle-point dynamic equation in the form of a Schwinger- 
Dyson equation. The dynamic field is here a SUSY correlator that encodes the 
usual correlation function, the advance and retarded linear responses and the fourth 
correlator (that vanishes for causal problems): 



G~\t)R(t, t') = 5(t - t') + 2 7 Q(t, t') + j dt" [E(t, t")R(t", t') + D(t, t")Q{t"t, ?)} , 

G~\t)C(t,t') = 2 1 k B TR{t',t) + j dt"X(t,t")C(t",t') + J dt" D(t,t")R(t',t") , 

^\t)R\t, t') = 5(t - t') + J°° dt" Z\t", t)R(t', t") + J dt" t{t, t")C(t", t') 
+2jl(t)C(t,t') , 

G^\t)Q(t,t') = j dt"^(t,t")Q(t",t') + J dt"±(t,t")R(t",t') + 2fi(t)R(t,t') , 
with G~\t) = Md 2 +-fd t + jj(t), G^\t) = Mtf-idt + nit), X f (M') = £(f,i) and 



E(M") = g 2 Y, F r(r + l)rC r - l (t,t")R(t,t") (9.13) 

r>0 

D(t,t") = g 2 Y, F r(r + l)C r (t,t") (9.14) 

r>0 

t(t,t") = g 2 Y, F r(r + l)rC r -\t,t"m,t"). (9.15) 

r>0 

We set to zero all fermionic correlators. We call the above integro-differential equa- 
tions the Schwinger-Dyson equations for R, C Rl and Q, respectively. 
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Causality can be used to simplify the four Schwinger-Dyson equations consider- 
ably. For t' > t one has R(t,t') = while for t > t' one has R(t',t) = 0. Rewriting 
the equations for R and Rf with these two choices of times one easily sees that 
Q(t,t') = for all t and t' (note that Q is symmetric in t and t') and Ho{t) = for 
all t. Thus, the equation for Q vanishes identically when causality holds. In the 
following we search for causal solutions and we work with their simplified version. 
We loose in this way the possibility of finding solutions that break causality which 
are related to instantons [65]. We shall come back to this point later. If we focus 
on the case t > t' the dynamic equations simplify to 

G~\t)R(t,t') = C dt"m,t")R(t",t') , (9.16) 
Jt' 

G~\t)C(t, f) = f dt" D(t, t")R(t', t") + f dt" E(f, t")C(t', t") . (9.17) 

JO JO 

In their integrated form they read 

R(t, t') = G Q (t, t') + /* dt" f dt 1 " G (t, t") Z(t", t'") R(t"', t') , (9.18) 

Jt' Jt' 

C(t, t') = f dt" C dt!" R(t, t") D(t", t'") R(t', t'") , (9.19) 
jo jo 

with the propagator given by G^(t, t') = 5{t — t')G 1 (t). 

The equation for ji{t) can be derived from the Schwinger-Dyson equation by 
imposing the spherical constraint through the evaluation at t = t'. Multiplying 
operationally by G„ 1 one obtains 

dt) = C dt!' Mi, t")C(t, t") + D(t, t")R(t, t")} 

JO 

+M f dt" f dt'" (d t R(t, t")) D(t", t'") (d t R(t, If")) (9.20) 
JO jo 

+ M 2 [d t R(t, s)d 2 st C(s, t) - d 2 st R(t, s)d t ,C(s, t')} \ s ^ fi . 

The last two terms are a consequence of having a kinetic term with second deriva- 
tives. It can be easily identified with minus the second-derivative of the correlation 
at equal times by taking the limit tf — > t~ in Eq. (9.17). Thus 



/i(t) = f dt" [£(f , t")C(t, t") + D(t, t")R(t, t")} - M ^C(t, If) 



(9.21) 



t'^t- 



One way of deriving the equation for /z(t) for a Langevin process with white noise 
and no inertia goes as follows. Considering t > t' in the complete Schwinger-Dyson 
equation for C and taking t' — > t~ , and considering t < t' in the same equation and 
taking tf — > t + , one finds 

lim d t C(t,t') = lim d t C(t,t') - 2k B T (9.22) 

t'->t- t'->t+ 
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where we used R(t,t' — > t~) = I/7. The derivative of C has a cusp at t — t' . 
The symmetry of the correlation function about t — t' implies C(t' + S,t') = 
C(t' — S,t') and an expansion up to first order in 8 implies \im t i_> t - dtC(t,t') = 
-\im t ,^ t +d t C(t',t). From Eq. (9.22) one has lim t ,^ t - d t C(t, t') = -k B T. Now, 
one rewrites the complete equation for C exchanging t and if and adds this equa- 
tion to the same equation in the limit if — > t~: 'y lim t /_,. t - (d t C(t,t') + d t >C(t,t')) = 
— 2/i(t) + lim t /^ t -[rhs eq. for C+rhs eq for C(t' <-> t)]. From the discussion above 
the LHS vanishes and the RHS implies 

roc 

H(t) =k B T+ / dt" \m, t")C(t, t") + D(t, t")R(t, t")} . (9.23) 

JO 

For the spherical p spin model /j,(t) is simply related to the energy density S(t). 
Indeed, take the Langevin equation evaluated at time t, multiply it by Sj(t'), sum 
over all sites, average over the noise and take the limit if — > t. Repeat this procedure 
with the Langevin equation evaluated at t' and multiplying by Si(t). Adding the re- 
sulting equations and using iV -1 J2iLi{si(t)^i(t')) = 2^kBTR(t,t') (see Appendix C) 
we have n(t) = — lim t /^ t - (j^i + ^bT that for the spherical p spin 

model becomes 

fi(t) = -p£(t) + k B T . (9.24) 

Thanks to the mean-field character of the model the action is proportional to 
iV and the saddle-point evaluation is exact when iV — > 00. For the fully connected 
models considered in this Section the self-energy is given by a rather simple func- 
tion of the interactions. In Section 9.2 we present a more powerful method that 
allows us to derive a similar equation for dilute (as opposed to fully connected) 
disordered models. For finite dimensional problems none of these procedures are 
exact. An effective action in terms of local order parameters Qi(a,b) can be writ- 
ten but the evaluation of the generating functional by saddle-point has to include 
fluctuations [83, 84]. 



9.1.2 Quantum models 

The similarity between the effective action for classical and quantum models can be 
exploited to derive the dynamic equations of a quantum system in a very similar 
manner to what we have just done for classical models [85]. Even if the SUSY 
notation is not useful for quantum problems we can still use a compact notation. 
We first encode the variables q, iq in a vector. The quadratic terms in the action 
can be condensed into one term by introducing the operator 





Op ++ (M') = (Md 2 t + n+(t))5(t-t')-2iv(t-t') 

Op + -(t,t') = 2r](t - t') + 2iv(t - t') 

Op-+(t,t') = -2rj(t - t') + 2iv{i - if) 

Op" (MO = — (M(9 t 2 + z~(t)) 5(t — t') — 2iv(i — if) (9.25) 
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in such a way that 

S EFF $ + J-] = -^Jdtj dt' Q (t) Op Q/3 (M')0V)-/ dtV[$ + }+ j dtV[$-\ (9.26) 

where Greek indices label +, — and the sum convention is assumed. 

Introducing the order parameter Q a/3 (t, t') = iV" 1 J2i 0f(O^f y i a the identity 

1 oc | n^Q a/3 ^g a/3 e-^^ (t-WPW-NQ-om) , (9.27) 

the full action can be rewritten as 

S EFF [0+, $~\ = -\jdtj dt' r(t) ( Op a "(t, t') + iQ^(t, o) ^(f) 

+f /df / dt?Q°*(t,1>) Q a ?(t,t') + ^Jdt (^(t) - /x-(*)) 
+ / - / . (9.28) 



The stationary-point values of Q a/3 (t,t') are related to the "physical" correlations 
and responses defined in Eqs. (8.29) and (8.30) as follows 

NQ++(t, t>) = = iV (c(f , - y (i?(t, + i2(f , f))) , (9.29) 

iVg+- (*, = ($+(t)$-{V)) = N (c(t, t>) + | (i2(t, o - , *))) , (9-30) 

%h 



NQ- + (t, t>) = (0-(t)0+(t')) = N \C(t, f) - - (R(t, t') - R(t>, t))j , (9.31) 

NQ-~ {t, = ($-(t)$-(f)) = N (c(t, + y (i2(f , f ) + i2(f , 0)) , (9.32) 

with NC(t,t') = EiCu(t,t') and NR(t,t') = EiRu(t,t')- It is easy to check that 
these functions satisfy the identity Q ++ (t,t')+Q—(t,t')-Q + ~(t,t')-Q~ + (t,t') = 0. 
At the classical level this identity reduces to the condition {is(t)is(t')) = for all 
pairs of times t, t'. In what follows we do not break this identity and hence do not 
allow for solutions that break causality. 

The functional integration over <f)f(t) and 4>^{t) is now quadratic and can be 
performed. Symmetrizing the operator Op with respect to the greek indices and 
times the integral over the fields + and _ amounts to replacing the quadratic 
term in i/hS EFF by 

~jJ dt J dfTHog Q0p^ MM (M') + i<Q^(t,0) • (9-33) 

At this stage, all terms in the action depend upon the "macroscopic" quantities 
iQ a/3 , Q a/3 and fi a and are proportional to N. Since it is easier to write the equations 
in matrix notation, we encode iQ a/3 and Q a/3 in two matrices 

6 ( iQ ++ iQ+- \ ( Q ++ Q+- \ 

lQ = { iQ- iQ- J Q = { Q-+ Q- ) 
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and we define 



r>0 



the saddle-point with respect to iQ af3 (t,t') yields iQ(M') = fCT^M') - Op(t,t'). 
The matrix and time-operator inverse of Q is denoted Qr x . The saddle-point equa- 
tion with respect to Q a/3 (t,f) yields iQ(t,t') = F[Q](t,t'). These saddle-point 
equations imply, in a compact matrix and time-operator notation, 

^0p SYMM ® Q = / - -L F [Q] Q , (9.35) 

where I is the identity: I a/3 (t,t') = 5 al3 5(t — t') and we denote with a cross the 
standard operational product in matrix and time (see Appendix D). The saddle- 
point with respect to fi a yields 

i/h = {Op + iQ)-\{t,t)=i/hQ ++ (t,t) , (9.36) 

and similarly for Q . These equations lead to the spherical constraint. 

The dynamic equations for the auto-correlation and response follow from the 
set of equations (9.34)-(9.35) and the definitions of the dynamic order parameters 
given in Eqs. (9.29)-(9.32). More precisely, the equation of motion for the response 
function follows from the subtraction of the ++ and H — components of Eq. (9.35): 

(Md?+i2 + (t))R(t,t')+4j t t / dt"r ] (t-t")R(t",t') = 5(t-t') 

|^ ^F?(r + l) J™ dt"{(Q+ + (tX)) r -(Q + -(tX)l] R(t",t') , (9.37) 



and the equation of motion for the correlation follows from the addition of the +- 
and — h components of Eq. (9.35): 



Md 2 t + \ (V(i) +/*"(*))] C(t,t>) + 1 (z+(t) - z~(t)) h(R(t',t) - R(t,t>)) 

fOO ft 

-2h / dt"u(t - t")R(t', t") + 4 / dt" v (t - t") C(t", t') 
Jo Jo 

= ~k E^ 2 (r + l)Im / dt" UQ ++ (t,t")YQ + -(t",t') 

m r>0 Jo 

-(Q + ~(t,t")YQ-(t",t')} . (9.38) 

Written in this way, Eq. (9.38) is complex. Its imaginary part yields fi(t) = 
yU + (t) = n~{t) Moreover, since the response is causal, products of advanced R(t,t") 
and retarded R(t",t') responses vanish identically for all t,t": R(t,t")R(t" ,t) = 
0, V t,t" and one can show that for any integer k > and any constants c±, 
c 2 , {C(t,t>) + Cl R(t,t>) + c 2 R(t',t)} k = [C(t,t') + Cl R{t,t')] k +[C{t,t') + c 2 R(t> ',*)]* 
-C k {t,t'). Using this property one has (Q ++ (t, t")) r -(Q + -{t, t")) r = 2ilm[C(t,t")- 
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§R(t,t")] r and lm[{Q++(t,t")) r Q + -(t",t') - (Q + "(t, t")) r Q-(t", t')} =2C(t",t>) 
x lm[C(t,t") - fR(t,t")] r -hR(t',t")Re[C(t,t") - f(R(t,t") + R(t",t))] r . We can 
identify the self-energy £ and the vertex D as 

£(f , + 4r](t - t') = t(t, t') D(t, t') - 2hu(t - t') = D(t, t') 

t(t, = - y E F ' (r + l)Im[C(f , t') - (ih)/2R(t, t')] r , (9.39) 

b{t, = ^ E F '( r + i)^^*. - (^)/ 2 + ^(*', 0)] r • ( 9 - 4 °) 

^ r>0 

Note that the total self-energy £ and vertex D are real and have two contributions 
of different origin: one arises from the interaction of the system and the bath (rj and 
v) and one is caused by the non-linearities stemming from the average over disorder 
(E and D). 

The dynamic equations can then be written in the compact form (9.13) - (9.13). 
It is important to realize that the self-energy £(£,£') is proportional to the response 
function R(t,t'), which in turns implies £(£,£') = £(£,£') = for t < t'. This means 
that the upper limit of integration in Eqs. (9.13) and (9.13) is t, which renders the 
equations explicitly causal. There are no more independent equations for R and C. 
The other two equations that can be obtained from Eq. (9.35) are the equation for 
R(t',t), that is equivalent to Eq. (9.13), and one equation that identically cancels 
by virtue of the identity between two-point correlators. 

Real and imaginary parts of Eqs. (9.36) and the one for Q combined with the 
saddle-point equation for A imply the equal-times conditions C(t,t) = 1, R(t, t) = 0. 
In addition, from Eq. (9.37) one obtains that the first derivative of the response 
function is discontinuous at equal times: 

lim_ d t R(t, = T7 > , lim = > ( 9 - 41 ) 

while from Eq. (9.38) one obtains that the first derivative of the correlation is 
continuous: 

Jim dtC(t, t') = lim d t C(t, = 0. (9.42) 

In conclusion, Eqs. (9.13), (9.13) and (9.21) are the complete set of equations 
that determines the dynamics of the system. 

9.2 Beyond fully-connected models 
9.2.1 Classical models 

A very useful formalism to study the statics of classical dilute disordered models 
with the replica trick has been introduced by Monasson [86] generalising the previous 
work of Mottishaw and de Dominicis [87]. The parallel between the static calculation 
using replicas and the dynamic formalism, once expressed in terms of superfields, 
exists also at the level of this approach. The presentation in this Section follows very 
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closely the one in [88] where the dynamic formalism apt to analyze dilute disordered 
models was introduced. 

The dilute spin-glass, or Viana-Bray model in its Ising version, is a spin model 
defined on a random graph with average connectivity c and pair random exchanges 
taken from the probability distribution P(Jij) = (1 — c/N) S(Jij) + c/N[^5(Jij — 
J) + \5{Jij + J)}. For the sake of simplicity we consider the spherical version of this 
model. Let us define c(<3>) as the fraction of sites with super-field <£>j identical to a 
chosen value $ 

^)4x;nw- $ i(«)). ( 9 - 43 ) 

i=l a, 

for all values of the super-coordinate a. Note that / X>$ c($) = 1. Similarly to 
what we have done when introducing Q(a, b) in Eq. (9.5) we enforce the definition 
of c(<£>) in the generating functional by introducing an identity in its path inte- 
gral representation: 1 oc / VcDic exp[/ £>$ ic($)(Nc($) - E^iLL^ - = 
JVcVic exp[/D$JVic($)c($) -*Z? =1 ic($i)]. We obtain 

Z = J V$i Vc Vic exp (f £>$ JVic($)c($) - ^ 

\ i=i 

+ y yp$c($) J da${a)(-DW - fji 9 (a))$(a) - J da V[$(a)]) . 

V[<&(a)] = Jij$i(a)$j(6). Once written in this form, the average over disorder 
can be simply performed and the disordered averaged generating functional becomes 
[Z] = JVcVicV^i exp (-NG) with 

/I N 1 r r- 

d$ ic($) c ($) + — X! ic($o + 2 y d$ c ( $ ) y rfa $ ( a )0°i 2) + ^(«)) $ («) 
i=i ~ 

and exp (—NH EFF ) = [exp (/ da V[$(a)])] With the notation NH EFF we suggest that 
H EFF is of order one. We shall discuss this very important issue below. 

The second term in G is now the only term where the <3>j's appear and all of them 
contribute in exactly the same form. One can then replace the sum over i by a factor 
N times &(<&') and exponentiate the functional integral over the representative super- 
field J*X>$jexp(-£i«c($i)) = exp(iVln /D$'exp(-ic($')))- The saddle-point 
equation on id reads ic($) = — In c($) — In ( / P$'e _ * c ^'^ . Replacing this expression 
for ic($) and using the fact that / "D$c($) = 1, the generating functional averaged 
over disorder becomes [Z] = JVc exp [ — N S EFF (c)] with 

S FFF (c) = jv<S> c($) lnc($) + \jv<$> c($) | da $(a)(L>f + ^(a))$(a) + H EFF . 

The first term is an entropic contribution, the second term is a kinetic energy and 
the third one is the potential energy. 

The difficulty now arises as to how to compute the effective Hamiltonian H EFF . 
For fully connected models as the ones discussed in the previous Section H EFF can 
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be calculated exactly and one recovers the dynamic equations that were already 
known (see below). For dilute disordered models, or models defined on a random 
graph, H EFF is still a quantity of order one. In this sense we still call them mean- 
field models. This property allows us to pursue the calculation with a saddle-point 
approximation. H EFF is determined by a set of iterative approximations. For finite 
dimensional models the situation worsens still since a saddle-point approximation 
cannot be used without taking into account the fluctuations around it. 



Gaussian approximation 



In this Section we assume that we deal with any model such that the effective ac- 
tion S EFF is indeed of order N. In a first step we resort to a Gaussian approximation, 
in which one proposes: 

C ($) = (detQ)~ 1/2 e -hJdadb^a)Q-\a,bMb) _ (g^ 

The denominator ensures the normalization of c($) and Q(a, b) is correctly given by 
the averaged correlator: Q{a,b) = N j V<5>± $ i (a)$ i (6) e - * I da ' db ' *(a')<r V,&'W) 
with J\f = (detQ)' 1 ^ 2 . After rather simple manipulations the c-dependent effective 
action can be expressed in terms of Q(a,b), 2S EFF (Q) = TrlnQ + / dadb S(a — 
b)(D%p + n s (a))Q(a, b) — 2H EFF (Q). Its variation with respect to Q yields: 

^=P = = ifl-'M) + \d>? + *<«0»M) - f=f ■ (9.45) 

Multiplying this equation operationally by Q(b, a') (see Appendix D) the dynamic 
equation takes the more familiar form (9.11) with E(a, a') = —25H EFF (Q) / 5Q(a, a'). 



One example: the infinite range p spin model 



The p spin spherical model is a particular case of the model in (9.2) with 
= yW 1 ...W pC (^...c(^)|d«ft^ 1 (a)^ 

= J dadb (Jv&c(&)&(a)&(b)y (9.46) 

Replacing the Gaussian Ansatz (9.44), H EFF becomes a simple function of Q(a, b): 

H EFF (Q) = - A J dadb Q' p (a, b) . (9.47) 

The full expression for the effective action S EFF (Q) is identical to Eq. (9.9). A way 
to prove that the Gaussian Ansatz (9.44) is exact for this model is to check that the 
exact equation for c($) coincides with the one obtained from the Gaussian Ansatz 
and the saddle-point evaluation. 
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A second example: the dilute spherical spin-glass 



In this case the effective Hamiltonian H EFF (c) reads 
-2H EFF (c) = -d + cJ £>$£>$' c(<l>)c(<l> , ) cosh (j J da $(a)$'(a)) . (9.48) 
With the Gaussian Ansatz, this expression becomes 

-2H EFF {Q) = -~c + c/ v /det(l - J 2 g 2 ) . (9.49) 
The self-energy can only be expressed as a series expansion or a functional: 

£(a, 6) = 5J 2 [g(l - J 2 Q)" 1 ](a, 6) = cJ 2 £ J 2k Q (2k+1) (a, b) . (9.50) 

k=0 

Using the first expression for £ one derives the dynamic equation 

(c - 1) J 2 g 2 (a, 6) + <S(a - 6) = (-£>< 2) - /i s (a)) (Q - J 2 g 3 )(a, b) . (9.51) 

Otherwise, if we use the second expression we obtain a dynamic equation involving a 
series. Note that this equation is much more complicated than the one for the fully 
connected p spin spherical model. The derivatives act on functionals of the correlator 
Q in this case. Moreover, the Gaussian approximation is not exact for dilute models. 
An iterative method can be implemented to go beyond this approximation. It was 
introduced in [88] but we shall not describe it here. 



9.2.2 Quantum models 

Once we have presented the method for the classical dynamics, its extension to 
a quantum system is simple. The important point to remark about the previous 
derivation is that the SUSY notation has been used, mostly, as a bookkeeping device. 
In the quantum case a SUSY formalism is not useful. Instead, it is convenient to 
use the formalism apt to take the classical limit, encoding the variables (q,iq) in a 
two-component (column) vector $, and defining a (line) vector v: 

*-U) 

the effective action reads 

S EFF = S Km (v-$ t ) - Skin (v* • $i) + S POT (v ■ $;) - S P0T (v* ■ $,) + S TH (^) (9.52) 

with the thermal part of the action written as 

S TH ($) = JdtJ dt' $t(t)A(t - t'^iif) . (9.53) 

Calling a = 1,2 the vector indices, the notation becomes identical to the SUSY 
one, with a here playing the role of the coordinate in super-space a = (t, 6, 6) in the 
classical problem. Just as in the previous Section, one introduces the identity (9.43), 
where a is now interpreted as a vector index, to rewrite the generating functional. 
The analysis of the kinetic and thermal part of the effective action follows the same 
lines as the one presented for the classical problem. 
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9.3 Field equations 

Once we have written the dynamic action in terms of <pi and ifa the "field equations" 
follow from exact properties of the functional integration [65]. Indeed, 



= / VSVid) ^ c -s^F[^i]+f c dtjm(t')Mt')+m(t')iMt')) 

j sib® 



I 



T>4>Vi(j> 



+ Vi(t) 



6i<f>i(t) 



The subinded C in the integrals stands for "time contour" and it can describe the 
usual integration from the initial time to infinity for classical models or the close 
time path for quantum ones. Taking now the variation with respect to the source 
ifjj(t') and evaluating at rj = if] = for all times and components we find 

o = ^-o^--(^(o ^7^ A) ) (9 - 54) 

\ OMpi{t) I 

where the brackets denote an average with the measure weighted by the dynamic 
action S EFF . If, instead one takes the variation with respect to r)j(t') and later 
evaluates at r] = if] = one obtains: 

(* w *H))=°- < 9 ' 55) 

A way to derive dynamic equations for the two-point correlators amounts to use 
Wick's theorem and rewrite these averages as a sum over all possible factorizations 
in products of two point-functions. This is of course exact if the action is quadratic 
but it is only a Gaussian approximation for more general models. This kind of 
derivation has been mainly used in the study of the dynamics of manifolds in random 
potentials [89]. 



9.4 The thermodynamic limit and time-scales 

It is very important to stress that the dynamic equations derived with the saddle- 
point approximation hold only when iV — > oo before any long-time limit is taken. 
They describe the dynamics in finite time-scales with respect to iV and they can- 
not capture the crossover from the non-equilibrium relaxation to the equilibrium 
dynamics reached in time scales that diverge with N [remember that t EQ (N)]. 

Previous attempts to study the dynamics of disordered glassy systems assumed 
that these same equations hold for the equilibrium dynamics when N is finite and 
time-scales diverge with N [90]. This assumption is wrong as shown by several 
inconsistencies found in the solution at low temperatures: (i) the asymptotic values 
of one time-quantities do not necessarily coincide with the values calculated with 
the equilibrium distribution, (ii) the solution exhibited violates the fluctuation - 
dissipation theorem. These two results are not compatible with equilibrium. 



54 



In order to study the equilibrium dynamics of these models one should (i) start 
from random initial conditions but reach times that grow with N or (ii) impose 
equilibrium initial conditions. The second route has been implemented - though 
without solving the full dynamic problem - by Houghton, Jain and Young [80]. 
They showed that in this case one is forced to introduce the replica trick to average 
over disorder. 

The dynamic equations here derived are correct when N — > oo at the outset. 
Since times are always finite with respect to N, when t EQ (N) diverges with N the 
dynamics is not forced to reach equilibrium and there is no contradiction if the 
solution violates the equilibrium theorems. 

9.5 Single spin equation 

In the limit N — > oo one can also write the full action S EFF in terms of a single 
variable. This is at the expense of modifying the thermal kernel and the interaction 
term in a self-consistent way, through the introduction of terms arising from the non- 
linear interactions (the vertex and self-energy, respectively). For a classical model 
with white external noise the single variable equation reads 

Mfait) + 7 Ht) + = f dt " ^(t, t") + Pi {t) + . (9.56) 

J o 

Its generalisation is straightforward. There are two noise sources in this equation: 
£i(t) is the original white noise while pi(t) is an effective (Gaussian) noise with 
zero mean and correlations self-consistently given by (Pi(t)pj(t')) = 8ijD{t,t'). The 
vertex D(t,t') plays the role of the colored noise correlation in a usual Langevin 
equation. The self-energy £(t, t') appears here in the place of an 'integrated friction'. 
A solution of the problem can be attempted numerically using this equation and the 
self-consistent definitions of £ and D. 

This procedure is not particular useful for the analysis of "polynomial" models 
since the transformation into a Q dependent effective action can be done exactly. 
It does however become useful for dealing with models whose single-spin effective 
action has higher order interaction terms. An example is the quantum SK model. 
This procedure is similar to the one used in dynamic mean- field theory [91]. 

Interestingly enough, as shown in Section 7.4, a rather flat harmonic oscillator 
coupled to a bath made of a white and a coloured part at different temperatures 
acquires two time-scales controlled by the two temperatures involved. We see that 
a similar structure might appear for the glassy system if the self-energy and vertex 
self-consistently arrange to act on each degree of freedom as the friction and noise- 
noise correlator of a complex bath. We shall see that this is indeed what happens to 
mean-field models. We believe that a similar mechanism arises in finite dimensional 
glassy models as well [72]. 
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10 Diagrammatic techniques 



In this Section we first describe the perturbative solution to the Langevin process and 
how it is used to construct series expansions for the correlations and responses. Self- 
consistent approximations, such as the mode coupling or the self- consistent screening, 
correspond to a selection of a subset of diagrams from the full series. The connec- 
tion with disordered models is demonstrated. The presentation is very close to the 
one in [92]. An extension to quantum problems is possible using the generating 
functional formalism. 

10.1 Perturbative solution 

Let us focus on a single scalar degree of freedom, q, with potential energy 

V( q ) = ^q 2 + § q ", (10.1) 

and dynamics given by the Langevin Eqs. (4.7) and (4.8) in the white noise limit. 
We take the initial condition q(t = 0) = 0. fi(t) is a time-dependent function that 
we fix at the end of the derivation by requiring C(t,t) = 1. In vector models it is the 
Lagrange multiplier that self-consistently imposes a spherical constraint. Note that 
this potential is not bounded from below. Setting G Q (t, t') = [/i(t) + 7<9 t + Mc^] -1 , 
a perturbative expansion for q(t) in powers of the noise is easily written as 

q(t) = (G ® (*) - | (Go ® [Go <g> f • Go ® £]) (t) + ... (10.2) 

where <g> means a time convolution, (G Q <g> f)(t) = Jq dt'G (t,t')f(t'), and • is a 
simple product at equal times. This notation is equivalent to the one used in the 
SUSY formalism, see Appendix D. Causality implies G (t,t') oc 8(t — t'). If inertia 
can be neglected G Q (t,t') = exp J t * dr h(t)^J 9(t — t'). If one keeps the second- 
time derivative G Q (t,t') takes a more complicated form. Equation (10.2) can be 
graphically represented as in Fig. 10. Crosses indicate noise and oriented lines 
indicate the bare propagator G . Each vertex carries a factor g/2. Note that the 
unknown q is evaluated at time t while the noises are evaluated at all previous times. 

— , + — <% 

Figure 10: Terms O(g ), 0(g 1 ) and 0(g 2 ) in the perturbative solution to the 
Langevin equation. 

The expansion for q leads to two expansions for the correlation and response. In 
simple words, the former corresponds to sandwiching, i.e. averaging over the noise, 
the usual product of two series as the one in Fig. 10 evaluated at different times t 
and t'. Due to the average over the Gaussian noise noise factors have to be taken 
by pairs. Let us illustrate this with a few examples. 
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The first term in the expansion is the result of averaging two O(g ) terms (first 
term in Fig. 10): 

C (t,t') = ((G ® 0(0 • (Go® 0(0) = 2 7^T f dt"G (t,t")G (t',t") , (10.3) 

Jo 

t > £'. We depict this term and its contributions to more complicated diagrams with 
a single crossed line, see the first graph in Fig. 11. The term O(g), as well as all 
terms which are odd powers of g, vanishes. There are two contributions to the term 
0(g 2 ). One is the result of multiplying a term 0(g 2 ) with a term O(g ) and it is a 
tadpole, see the second graph in Fig. 11; we assume this term and all its corrections 
are included in the contributions from the time-dependent mass and we henceforth 
ignore them. The other comes from multiplying two O(g) terms, see the third graph 
in Fig. 11. 

Higher order terms are of two types: they either dress the propagators or they 
dress the vertices, see the last two diagrams in Fig. 11. These two terms are order 
0(g 4 ). The first one follows from averaging two 0(g 2 ) contributions while the second 
one is the result of averaging an 0(g 3 ) and an O(g) term. The full series yields the 
exact perturbative expansion for C. 




Figure 11: From left to right: O(g ), two 0(g 2 ) and two 0(g 4 ) terms in the series 
for C. The next to last diagram dresses the propagator and the last term dresses 
the vertex. The former is kept in the MCA while the latter is neglected. 

The series expansion for the response follows from the relation (8.8) in the white 
noise limit. In graphical terms we obtain it by multiplying the series in Eq (10.2) and 
Fig. 10 evaluated at time t by a noise evaluated at time £' and taking the average. 

10.2 The mode coupling approximation (mca) 

The diagrammatic expansions for C and R can be represented analytically by in- 
troducing the kernels £(£,£') and D(t,t') through the Schwinger- Dyson equations 
(9.18) and (9.19) in their integral form. Each of them is a compact notation for a 
series of diagrams. These equations are exact perturbatively. However, for a generic 
model one cannot compute the kernels S and D exactly. 

The mode coupling approach amounts to approximating the kernels £(£,£') and 
D(t,t') in the following way. One takes their values at 0(g 2 ) and substitutes in 
them the bare propagator G Q and the bare correlation Cq by their dressed values, 
i.e. by R and C themselves. For the model defined in Eq. (10.1) this yields 

£(£,£') = g 2 C(t,t')R(t,t') , (10.4) 
D(t,t') = 2 1 k B T 5(t-t') + 9 — C 2 (t,t') . (10.5) 
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This approximation neglects "vertex renormalization" in the sense that all diagrams 
correcting the values of the lines are taken into account while all diagrams correcting 
the vertices are neglected. For instance, one keeps the fourth diagram in Fig. 11 
that represents a line correction, while leaving aside the fifth diagram drawn in the 
same figure that represents a vertex correction. 

The same procedure can be implemented using the SUSY representation of the 
dynamics. Each line represents the superfield and the super-correlator follows from 
the sandwich of two series for the super-field evaluated at different super-coordinates 
a and b. 

The Schwinger-Dyson equations can be recast, after multiplying by G^ 1 , into 
the form (9.16) and (9.17) for a random potential (9.2) with only one term r = 
p = 3. Applying the MCA to the trivial (and ill-defined) model (10.1) we derived 
the dynamic equations for the p = 3 spin spherical model! On the one hand, this 
result is worrying since it shows that the MCA can be rather uncontrolled and it 
can generate glassy behavior by itself. On the other hand, since the same equations 
hold in the MCA of a model of interacting particles with realistic interactions, this 
calculation allows one to understand why the dynamic equations of the mct for 
super-cooled liquids coincide with the ones of disordered spin models above In 
the next Subsection we show how the diagrams neglected in the MCA vanish in a 
disordered model with a large number of components. (See also [93] for other recent 
discussions of the meaning and range of validity of the MCA and mct.) 

10.3 MCA and disordered models 

The first to notice that the MCA for a "quadratic" dynamic equation corresponds 
to the exact dynamic equation of a disordered problem with a large number of 
components was Kraichnan [94] in the context of the Navier-Stokes equation. More 
recently, Franz and Hertz showed that the "schematic mct equations of the F p 
group" for super-cooled liquids are identical to those arising from a spin model with 
pseudo-random interactions between groups of three spins [95] . (The schematic mct 
focus on a chosen wavevector.) 

Indeed, for the example chosen in this Section, one easily demonstrates that 
the diagrams retained by the MCA are precisely those which survive if one modifies 
the initial model (10.1) and considers instead the following disordered problem [92]. 
First, let us upgrade q to a vector with N components or "colors" fa, where i = 
1,2, N. Second, let us modify the potential energy (10.1) into 

= 9 J2 J ijk <Pi<Pj<Pk (10.6) 
i<j<k 

with couplings that are independent quenched Gaussian random variables of 
zero mean and variance [Jfj^j = 1/A P_1 = 1/N 2 . (p is the number of spins in each 
term in V .) In the large N limit, the noise and disorder averaged correlation and 
response of this modified model obey Eqs. (9.16) and (9.17) with £ and D given by 
Eqs. (10.4) and (10.5), respectively. The fact that these equations are recovered can 
be seen either directly on the perturbation theory, or using the functional methods 
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given in Section 8. Since we want to stress that the diagrams neglected in the MCA 
vanish exactly for this model we use here the first approach. 

The bare propagator is diagonal in the color indices, G oi j = G 5ij. The vertex 
is now proportional to the random exchanges J^. The perturbative solution to the 
Langevin equation reads 

&(f) = (G <g> &)(t) - J ijk G <g> (Go <g> • G <g> &)(*) + •• ■ . (10.7) 

One is interested in computing the self-correlation averaged over the noise and dis- 
order, iV -1 E£i[<0i(O^i(O]- The latter 

average eliminates all terms with an odd 
number of couplings. Similarly, since J^k ^ only if all indices i,j, k are different, 
tadpole contributions as the one in the second graph in Fig. 11 vanish (the noise- 
noise correlation enforces that two indices in the random exchange must coincide). 
Finally, one can check that due to the scaling with N of the variance of the dis- 
ordered interactions, vertex corrections as the one in the last graph in Fig. 11 are 
sub-leading and vanish when iV — > oo. Instead, all line corrections remain finite in 
the thermodynamic limit. We can check this statement in the two examples shown 
in Fig. 11 extended to include color indices. The vertex correction has four ran- 
dom exchanges that due to the averaging over the noise are forced to match as, e.g. 
JijkJjimJmniJkin leaving 6 free-indices. Averaging over disorder one identifies the 
indices of two pairs of J's, e.g. i = I and k — m, this yields a factor (1/iV 2 ) 2 and, 
at most, it leaves 4 color indices over which we have to sum from 1 to N k, n). 
We have then an overall factor 1/iV 4 x N A = 1 and this term vanishes when one 
normalises the correlation by N. Instead, in the line correction, after averaging over 
the noise, we are left with 6 free indices, e.g. JikjJkimJimnJinj, the average over the 
noise only imposes k = n in its most convenient contribution, and the overall factor 
is 1/iV 4 x N 5 = N. This term contributes to the normalisaed global correlation. 

Interestingly enough, the equivalence between the MCA and a disordered system 
extends to an arbitrary non-linear coupling F(q). Expanding F in a power series 

F(q) = ET=2 |f Q r the MCA leads to 

oo p2 

S(M') = g 2 ErzTw^ftOflftO, (10.8) 

r=2 v L )- 

OO T?2 

D(t, t') = 2 1 k B T5(t -t')+g 2 Y.^V C r (t, t) . (10.9) 

r=2 r! 

[Note that for r odd, there appears an additional "tadpole" contribution in Eq. (10.8), 
which we have assumed again that it has been re-absorbed into the mass term 
The dynamic equations can also be obtained as the exact solution of the Langevin 
dynamics of iV continuous spins 4>i interacting through the potential 

oo 

Vj[$\=gY,F r E (10-10) 

r>2 ii<...<v_|_i 

where J ai ,..a r +i are quenched independent Gaussian variables with zero mean and 
[(J ai ,..a r+1 ) 2 ] oc N~ r . Therefore the MC equations for a single dynamic variable 
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in contact with a heat reservoir and under an arbitrary nonlinear potential F(q) 
describe exactly a fully-connected spin-glass problem with arbitrary multi-spin in- 
teractions or a particle evolving in an N dimensional space in a quenched random po- 
tential V[cf>] with a Gaussian distribution with zero mean and variance (9.3) [96, 89]. 
Let us note that in order to be well defined, the model given by V must be sup- 
plemented by a constraint preventing the field <f>i from exploding in an unstable 
direction set by the coupling tensor Ji lm ..i r+1 . This problem is cured by imposing the 
spherical constraint J2?=i 4%(t) = NC(t,t) = N. 

The extension of the mapping to a space dependent (f>(x, t) (or to a multicom- 
ponent field) is straightforward. Several interesting physical examples involve an 
equation of the type: 

^MjM = _ ( ^ + ^0 ( £ )t) _£ £ ^C r (k\k U k r )^(h,t)..J(k r ,t)+C(k,t) 

k ~\_ . . . kf 



where <j>(k,t) is the Fourier transform of (f>(x,t), and £(k,t) a Gaussian noise such 
that (£(k,t)£(k',t')) = 2-fk B T5(k + k')5(t - t'). The Kardar-Parisi-Zhang (kpz) 
equation [97] corresponds to r = 2, C 2 (k\ki, k 2 ) = [ki • fe] 5(k\ + k 2 + k), while 
domain coarsening in the 4 theory corresponds to r = 3, £ 3 (k\ki, k 2 , k 3 ) = 5{k\ + 
k 2 + k 3 + k), with a negative /i [1]. The Navier-Stokes equation is similar to the 
kpz case with, however, an extra tensorial structure due to the vector character of 

— * 

the velocity field. The correlation and response functions now become k dependent, 
5 d (k + k')C(k,t,t') = (4>(k,t)j>(k',t')) and 5 d (k + k')R(k,t,t') = (d^(k,t)/d^(k',t')}. 
The generalized MC equations then read (assuming that the structure factors are 
invariant under the permutation of k-y, k r ): 

E(k,t,tf) = g 2 ( r _ r ^j J2 C r (k\k u k r )£ r (k r \k 1: k) 

k \ . . . kj- 

C(h, t, t')...C(fc r _i, t, t')R(k r , t, t') (10.11) 
D(k,t,t') = 2 1 k B T5(t-t')+g 2 ]T-^- E {£r(k\ki, K)) 

k\ i . . kf 

C(k 1 ,t,t')...C(k r ,t,t') (10.12) 
where S(/c,t,t') and D(k,t,t') are defined in analogy with Eqs. (10.8) and (10.9). 



10.4 MCA for super-cooled liquids and glasses 

In the last 20 years the MCA has been much used in the study of super-cooled liquids. 
Starting from the realistic interactions between the constituents of a liquid, Gotze et 
al [98] used the MCA together with an assumption of equilibrium to derive a dynamic 
equation for the density-density correlator. This analysis lead to the schematic mode 
coupling theory (mct) [99] of super-cooled liquids and generalisations [100] (with no 
reference to wave- vector dependence) and to more sophisticated versions that include 
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a dependence on space [98]. The difference between these models lies on the form 
of the kernels E and D. Kirkpatrick, Thirumalai and Wolynes [11] realized in the 
late 80s that the schematic mode coupling equation [99] is identical to the dynamic 
equation for the spin-spin correlator in the disordered Potts or p spin model, building 
a bridge between the study of structural and spin glasses. Why these models and 
not SK? This will become clear when we present their dynamic and static behavior. 

In this Section we explained why the dynamic equation of a disordered model and 
the one stemming from a MCA of a model with more realistic interactions coincide: 
the terms neglected in the latter vanish exactly in the former. The example studied 
here serves also to signal the danger in using a MCA. One could conclude that a trivial 
model has a highly non-trivial dynamics, this being generated by the approximation 
itself. 

In the derivation of the dynamic equations presented in this Section no assump- 
tion of equilibrium was used. Therefore, these equations hold also in the low tem- 
perature phase where equilibrium is lost. It is then natural to propose that the dy- 
namics of the p spin spherical model below T d schematically describes the dynamics 
of glasses just as its dynamics above T d yields the schematic mct of super-cooled 
liquids [13]. To go beyond the schematic theory while still keeping a single mode 
description (as in [100]) one simply has to consider p 1 + p 2 spherical disordered 
models. Moreover, the dynamics of a manifold in a random potential is described 
by dynamic equations with a k dependence that goes beyond the single mode MCT. 

Recently, Latz showed how the generic dynamic equations derived in this Section 
can also be obtained starting from the microscopic fluid system and using the MC ap- 
proximation though with no equilibration assumption [102]. Alternative derivations 
of mode-coupling equations are discussed in [93] 

Kawasaki and Kim [103] derived the same schematic MC equation using a non- 
disordered quadratic Hamiltonian for densities and velocities complemented with 
random non-linear dynamic equations. Interestingly enough, in this case the mct 
arises from a model with trivial statics and complex dynamics. Tunning the ratio 
between the number of density variables and velocity variables they even managed 
to include the so-called "hopping term" that softens the dynamic transition [98, 
101]. Is worth noting that in Kawasaki and Kim's model this term is not due to 
thermally activated processes but to the effect of the velocity-like variables through 
the complex dynamics. 

11 Glassy dynamics: Generic results 

Before presenting the explicit solution to the mean-field models we state some generic 
features of the low-T dynamics that we believe hold in general. 

11.1 The weak-ergodicity breaking scenario 

Figure 12-right shows a sketch of the decay of the correlation as obtained from 
the numerical solution to the dynamic equations for the mean-field models (see 
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Figure 12: Left: Sketch of the decay of the stationary correlations in the high T 

phase close to T d , T\ > > Right: Sketch of the decay of the aging correlations 

in the low T phase, at fixed T < T d , t[ < t' 2 < . . . 

Section 12.1). It develops a separation of time scales in the long t' limit. It first 
approaches a plateau at q EA in a stationary manner and it then decays below this 
value with an explicit waiting-time dependent form. For each waiting-time there is 
a sufficiently long t such that the correlation decays to zero. These properties are 
included in the weak- erg odicity breaking (web) scenario that states that, for t > t', 
C decays in such a way that 



lim C(M') = Qea + C ST (t - f) (11.1) 

t — >oo 

lim C ST (t-t') = Q lim lim C(t, t') = q BA (11.2) 

t— t'— »oo t— t'— ►00 t'^oo 

lim C(t,t') = at fixed t' . (11.3) 

t — >oo 

Equation (11.2) defines the Edwards-Anderson order parameter, g EA . For finite t' 
there is a crossover between two time-scales controlled by a waiting-time dependent 
characteristic time To(i') that is a growing function of t' whose precise form depends 
on the model. For large t > t' such that t — t' is small with respect to T (t'), the 
correlation function first decays from 1 to g EA in a tti manner. At longer t—t' it goes 
further below q EA to eventually reach in a manner that depends both upon t and t' 
(the aging effect). This behavior suggests the presence of at least two time-sectors 
in which the dynamics is stationary and non- stationary, respectively. We shall see 
that the number of time-scales, or more precisely correlation scales, depends on the 
model. 

We write C as the sum of a stationary and an aging contribution: 

C(M') = C sr (t-t')+C AG (t,t') . (11.4) 

The matching conditions at equal times between C ST and C AG are C(t, t) — 1 imply- 
ing C ST (0) + C AG (t,t) = 1 with C ST (0) = 1 — g EA and C AG (t,t) = q EA . Together with 
Eq. (11.2) they ensure that in the two-time sector in which C ST decays from 1 — g EA 
to 0, C AG is just a constant g EA . Instead, in the two-time sector in which C AG decays 
from g EA to 0, C ST vanishes identically. 
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The name web [45, 12] reflects the fact that for short time- differences the system 
behaves as if it were trapped in some region of phase space of "size" q EA - suggesting 
ergodicity breaking. However, it is always able to escape this region in a time- 
scale T (t') that depends upon its age t'. Hence, trapping is gradual and ergodicity 
breaking is weak. q EA depends on temperature when T < T d . 

We have already described, phenomenologically, such a separation of time-scales 
in the decay of correlation functions when we discussed the domain growth problem 
and glassy dynamics in Section 2. The first term describes in this case the fast 
fluctuations within domains while the second term characterises the domain growth 
itself. A second example where such a separation of time-scales occurs are the trap 
models in phase space. The first term corresponds to the dynamics within the 
traps while the second describes the wandering of the system from trap to trap. 
In glasses, the first term corresponds to the rapid rattling of each particle within 
its cage while the second one describes the destruction of the cages and hence the 
structural relaxation. 

In driven models rendered stationary by a weak perturbation we also find a sep- 
aration of time-scales with r increasing with weaker strengths of the perturbation. 
We can also propose that C and R separate in two terms, both being stationary but 
evolving in different time-scales. 

In classical purely relaxational models governed by a Langevin equation with 
no inertia the correlation functions are monotonic with respect to both times t and 
t', as it is easily checked numerically. Inertia introduces oscillations and the decay 
can be non- monotonic. The magnitude of the oscillations depends upon the relative 
value of the mass M with respect to the other parameters in the problem. However, 
for a wide choice of parameters the oscillations appear only in the stationary regime, 
the aging dynamics having a monotonic decay towards zero. This is relevant since 
it allows one to use the general properties of monotonic correlation functions proven 
in [104] and discussed in Section 11.4 to find the two-time scaling of C AG (t,t'). 

11.2 The weak long-term memory scenario 

Regarding the response function, we propose a similar separation in two terms: 



with R ST (t — t') = lim^oo R(t, t'). The matching conditions close to equal times 
are different for a model with or without inertia. In the former case, R(t, t) = 0, 
R(t,t~) = 1/M while in the latter, using the Ito convention, R(t,t) = ,R(t,t~) = 
I/7. In both cases the equal-times condition implies R ST (0) = 0, R AG (t,t) = 
while the next-to-main diagonal values yield R ST (5) = 1/M, R AG (t,t — S) — and 
R ST (5) = I/7 , R AG (t, t — 5) = 0, respectively. 

The response tends to zero when times get far apart, and its integral over a finite 
time-interval as well: 





lim R(t, t') = , 

t— +00 




V fixed t' . 



(11.6) 
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These properties imply 



lim lim R(t, t') = =>• lim R ST (t - t') = , lim i? AG (t, t') = . (11.7) 

However, the contribution of the response to the dynamic equations and to other 
measurable quantities is not trivial. Examining the integral of the response function 
over a growing time interval one finds that even if the response vanishes, it yields a 
contribution to the integration. Figure 15- left shows the integrated linear response 
(5.6). Using (11.5) 

X (t, = f dt" [R ST (t - t") + i2 AG (f, t")] = XsS - + Xag(*, • (H.8) 
Jt' 

If, for long enough t', the contribution of the second term in (11.8) were negligible, 
x(t, t') should be a stationary quantity. Instead, for all t's studied and for t long 
enough one clearly sees a waiting-time dependence that can only come from the 
integration of the second term. This is a weak long-term memory (wltm), the 
system has an "averaged" memory of its past. 

When a system is in equilibrium, the response is simply related to the correlation 
via fdt. We then assume (and test on the dynamic equations) that the dynamics 
in the stationary regime satisfies FDT: 

^ = -I S / % ^ha tmh frQ C » M (1L9) 

in a classical and quantum problem, respectively. One can formally prove that 
fdt has to hold for any generic relaxing model fro short time- differences [105], see 
Section 11.5.4. For longer time-differences, when C AG and R AG vary in time while 
C ST and R ST have decayed to zero, one cannot assume the validity of fdt and, as 
we shall see, the equations have a solution that explicitly modifies fdt. 



11.3 Slow time-reparametrization invariant dynamics 

We have already mentioned that the correlations decay monotonically (only below 
q EA if M ^ 0). The final insight coming from the numerical solution to the full equa- 
tions is that the dynamics becomes slower and slower for fixed waiting-time and as 
t — t' increases. In the stationary regime d t i [C(t, t'), R(t, t')] and d t 2 [C(t, £'), R(t, t')] 
are not negligible with respect to the terms in the RHS of Eqs. (9.16) and (9.17). On 
the contrary, in the second decay below q EA , C and R decay in a much slower man- 
ner such that, d t C(t,t') < -fi(t)C(t,t') and d#C(t,1f) < -fi(t)C(t,t') (similarly 
for R), and the time- derivatives can be neglected. 

We choose the following strategy to solve the equations in the long t' limit where 
a sharp separation of time-scales can be safely assumed. First, we take advantage 
of the fact that one-time quantities approach a limit, as one can verify numerically, 
and write the asymptotic form of Eq. (9.23) for /i^. The integrals on the RHS are 
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approximated using the separation of C and R in two terms that vary in different 
time-scales that we assume are well-separated. We detail this calculation below. As 
regards to the equations for C and R, we proceed in two steps. On the one hand, we 
choose t — t' short in such a way that C > q EA and we write the dynamic equations 
for C ST and R ST . On the other hand, we take t and t' widely separated so as C < q EA 
and we write the dynamic equations for C AG and R AG . In this way we double the 
number of unknown functions and equations but we simplify the problem enough as 
to make it solvable. 

Once the time-derivatives are neglected and the integrals are approximated as we 
explain in Section 12.3.3 the aging equations become invariant under reparametriza- 
tions of time t — > h(t) that transform the two-point functions as 

C AG (M') - C AG (h(t),h(t')) , R AG (t,t') - [dth(t')] R AG (h(t),h(t')) . (11.10) 

This is not an exact invariance of the dynamic equations. It is only generated when 
dropping the time-derivatives. This invariance was first noticed by Sompolinsky [90] 
in his study of the equilibrium dynamics (see also [8] and it later appeared in the 
nonequilibrium dynamics [12, 104, 96, 72, 106]. We shall see that this approximation 
forbids us to solve completely the dynamic equations, in particular, to fix the time 
scaling (select h(t)). 

11 A Correlation scales 

Take three ordered times t 3 > t 2 > t±. The correlations are C(U, tj) = jfY,k( s k(U)sk(tj 
cos 6ji . The monotonicity of the decay of the correlations with respect to the longer 
time (keeping the shorter time fixed) and the shorter time (keeping the longer time 
fixed) allows us to derive general properties that strongly constrain the possible 
scaling forms. Indeed, one can relate any three correlation functions via triangle 
relations [104] constructed as follows. Using the fact that the decay is monotonic, 
one can invert the relation between correlation and times to write, for example, 
h = g(C(t 2 ,ti) : ti) with g : [0,1] x [0, oo] — > [0,oo]. This allows us to rewrite 
C(i 3 ,ii) as 

C(t 3 ,h) = C{g{C{hM)M)M) = C , ^(C(t3,t 2 )^(C(t 2 ,t 1 ),t 1 ),t 1 ) . (11.11) 

We now define a real function f(x,y), f : [0, 1] x [0, 1] — > [0, 1], by taking the limit 
ti — > oo while keeping the intermediate correlations fixed 

lim C(t 3 ,h) = /(C(t 3 ,*2),C(* 2 ,*i)). 

ti — > oo 

C{t 2 M) and C(t 3 ,t 2 ) fixed 

The fact that the limit exists is a reasonable working assumption. This function 
completely characterizes the correlations and their scales in the asymptotic limit. 
(Note that we defined / using the correlation between the longest time and the 
intermediate as the first argument.) 
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11.4.1 Properties 

The definition of the function /, as well as the properties shown in this Subsection, 
are model independent. The form taken by / for each model is determined by the 
dynamic equations. 

Time reparametrization invariance The function / is invariant under reparametriza- 
tions of time that satisfy (11.10). 

Associativity Take now four times t± > t 3 > t 2 > t±. The correlation between t 4 and 
t\ can be written in two ways 

C(U, fx) = f(C(U, t 2 ), C(t 2 , ti)) = /(/(C(f 4 , t 3 ), C(t 3 , t 2 )), C(t 2 , h)) , 
C(U, h) = f(C(U, t 3 ), C(t 3 , h)) = f(C(U, t 3 ), f(C(t 3 , t 2 ), C(t 2 , ^))) . 

Thus / satisfies f(f(x,y),z) = f(x,f(y,z)), i.e. it is an associative function. 
Identity. If one takes ti = t 2 

C(t 3 , h) = f(C(t 3 , t 2 ), C(t 2 , h)) = f(C(t 3 , t,), C{hM)) = f(C(t 3 , *!), 1) , (11.12) 

for all C(t 3 ,ti) G [0, 1]. Equivalently, if one takes t 2 = t 3 

C(t 3 , h) = f(C(t 3 , t 2 ), C(t 2 , h)) = f(C(t 3 , t 3 ), C(t 3 , h)) = /(l, C(t 3 , t,)) , (11.13) 

for all C(t 3 ,t 1 ) E [0,1]. The correlation at equal times acts as the identity since 
x = f(x,l) and y = f(l,y) for all x,y e [0,1]. 

Zero. Taking t 3 and t 2 and much larger than t\ in such a way that C(t 2 ,ti) ~ and 
C(t 3 ,ti) ~ while C(t 3 ,t 2 ) > 0, 

~ C(t 3 ,*i) = f(C(t 3 ,t 2 ),C(h,ti)) ~ /(C(t 3 ,* 2 ),0) • (11.14) 

Equivalently, taking t 3 ^> t 2 and ti, then C(t 3 ,t 2 ) ~ and C(t 3 ,ti) ~ while 
C(t 2 , ti) > and one has 

~ C(t 3 , ti) = f(C(t 3 , t 2 ), C(t 2 , t,)) ~ /(0, C(* 2 , tx)) . (11.15) 

The minimum correlation acts as a zero of f(x, y) since = f(x, 0) and = /(0, y) 
for all x,y <E [0, 1]. (This property can be easily generalised if the correlation ap- 
proaches a non-zero limit.) 

Bound. Given that we assume that the system drifts away in phase space, C(t 2 ,ti) 
decays as a function of t 2 for t\ fixed, and C(t 2 ,ti) increases as a function of t 1 for 
t 2 fixed. This property implies 

y = f(l,y)>f(x,y) Vy,x<l, x = f(x, 1) > f(x, y) Vx, y < 1 . (11.16) 

Therefore f(x,y) < mm(x,y). 
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Forms for f In [104] we proved that 

f(x,y) = ]~ l (j(x)j(y)) Isomorphic to the product (11.17) 
f(x,y) = min(x, y) Ultrametricity (11.18) 

are the only possible forms that satisfy the properties of / shown above. Note that 
for j equal to the identity the first type of function becomes simply f(x,y) = xy, 
hence the name. It is also possible to prove that the first kind of function (11.17) is 
only compatible with the time scaling [107, 104] 

c{t ^= r im) (1L19) 

with h(t) a monotonically growing function. The actual correlation can have a 
piecewise form. Here, instead of reproducing the proofs given in [104] we explain 
these statements reviewing the scaling forms found for some physical systems and 
in the analytic solution to mean-field models. 

Examples: domain growth 

The correlation decays in two steps, see the right panel in Fig. 12 and for C > 
<?ea = rn EQ the decay is stationary: 

C 21 = C{t 2 , h) = q EA + C ST (t 2 - tx) , (11.20) 

and it can be put in the form (11.19) using h(t) = exp(lnt)) and ]~ l (x) = q EA + 
C ST (x). Any three correlation satisfying (11.20) also verify £ 3 — 1\ = C^-{Czi — ? E a) = 
h-t 2 + t 2 -ti = C OT 1 (C , 32 - q EA ) + C~^(C 2 i - g EA ) that implies 

C 3 i = C ST [C- T \C 32 - g EA ) + C^{C 21 - g EA )] + q EA . (11.21) 

This equation is equivalent to (11.17). This means that any three correlations above 
q EA can be related with an / that is isomorphic to the product, see (11.17), with 
Jst( x ) = C ST (lnx) + q EA and j ST (x) = exp(C OT 1 (a; - q EA ). 

When the times are such that the domain walls move, the self-correlation decays 
below q EA in an aging manner, with 

C 21 ee C(t 2 , tl ) = C AG {t 2 M)=J A l (!|^) , (11-22) 

Jag(1) = 9ea and Jag(0) = 0. It is obvious that any three correlations below q EA also 
satisfy (11.17) 

Take now ^3 = ^2 + r 32 with r 32 < r (t 2 ) and C 32 > q EA , and t 3 and t 2 sufficiently 
larger than ti (t 3 — t± + r 31 with r 31 > r (ti) and t 2 — t\ + r 2 i with r 2 i > T (ii)) 
such that C 3 i < q EA and C 32 < q EA . One has 
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The last idendity is a consequence of TZ(tz)/TZ{t 2 ) ~ 1 since for a sufficiently small 
r 32 , n'{t 2 )T Z2 /K(t 2 ) < f . 

Thus, when the times are such that two correlations, say with values a and 
b, are both greater than q EA one explores the dynamics in the stationary regime 
and f(a, b) is isomorphic to the product. When they are both smaller that q EA one 
explores the dynamics in the aging coarsening regime and again f(a, b) is isomorphic 
to the product though with a different function j. Finally, if a > q EA and b < q EA , 
f(a, b) = min(a, b) and one finds dynamic ultrametricity. 

The structure discussed in the context of the domain growth problem is indeed 
generic. Some special values of the correlation act as "fixed points" of f(a,a), 
/(a, a) = a. A "correlation scale" spans the values of correlations comprised between 
two subsequent fixed points. Within a correlation scale / is isomorphic to the 
product. Any two correlations falling into different correlation scales are related by 
an ultrametric /. In the domain growth example 1, q EA and are fixed points that 
are simple to visualize physically. In more abstract models as the SK spin-glass the 
form of / is more involved, with a stationary scale between 1 and q EA and a dense 
set fixed points, hence correlation scales, that fill the interval [0, q EA \. 

Scaling functions 

Most solvable models, numerical data and experimental results can be described 
with only two correlation scales, a stationary and a slow one. Several scaling func- 
tions h(t) for the slow decay have been proposed in the literature. In the following 
we summarize and discuss the main ones. In Fig. f 3 we compare the decay of the 
correlation from q EA for three of the four laws discussed below. 

Power law: h(t) = at a . This is the simplest scaling also called simple aging. Ferro- 
magnetic domain growth realizes this form with a = 1/2 for non conserved dynamics 
and a = 1/3 for conserved dynamics [1]. Several solvable model have simple ag- 
ing, an example being the classical spherical p = 2 model [108, 109]. In [12] it 
was conjectured that a power law also characterized the aging dynamics of the fully 
connected p spin- model with p > 3. This was later confirmed with the algorithm 
of Kim and Latz [110] that allows one to reach much longer times. Aging below T c 
in the simplest trap model also scales with this law [45]. The molecular dynamic 
simulations of Lennard- Jones mixtures show this type of scaling too. Note that for 
all a, C scales as a function of t 2 /t 1 . 

Enhanced power law: h(t) = exp(ln a (t/t )) This law yields the most accurate de- 
scription of spin-glass experimental data. The exponent a typically takes a possibly 
T-dependent value about 2 [31]. 

Stretched exponential: h(t) = exp[(t/t ) a ] This law has been proposed to describe 
the slowing down of the full correlation above the critical temperature. As far as we 
know, no aging model that satisfies a scaling (11.19) with a stretched exponential 
has been found yet. 

Logarithm: h(t) = ln a (t/t ) In the Fisher and Huse droplet model for spin-glasses, 
activated dynamics is assumed and the domains are found to grow as 1Z(t) ~ ln(t/t )- 
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Figure 13: Comparison between three h(t)s, power law, enhanced power law and 
logarithm. Plot of C(t,t') = (1 — g EA ) exp(— (t — t')) + q EA h(t)/h(t') against the 
time-difference t — t' (on the left) and against the ratio of times t/t' (on the right) 
for three waiting times. Note the drift of the curves in the right panel. For the 
logarithmic law (sub-aging) the curves drift towards the left for increasing waiting- 
time. Instead, for the enhanced power law (super-aging) the curves drift to the 
right for increasing waiting-time. For the power law (simple aging) the scaling is 
perfect. In real systems the decay of the stationary part towards g EA is much slower 
than exponential (typically power law with a small exponent) and the separation of 
time-scales is not so neat. 

This leads to C(t 2 ,£i) ~ g(hi(t2Ao)/hi(ti/to))- However, this law does not fit the 
aging experimental data [31]. 

Dynamic ultrametricity: Even though it seems mysterious at first sight there is a 
simple graphical construction that allows one to test it. Take two times £3 > t\ 
such that C(t 3 ,ii) equals some prescribed value, say C(£ 3 ,£i) = 0.3 = C31. Plot 
now C(t 3 ,i 2 ) against C(t2,ti) using t 2 , t 1 < t 2 < £3, as a parameter. Depending on 
the value of C31 with respect to q EA we find two possible plots. If C(t 3 ,ti) > q EA , 
for long enough t±, the function / becomes isomorphic to the product. Plotting 
then C(ts,t2) for longer and longer t\, the construction approaches a limit in which 
C(t 3 ,t 2 ) = J _1 (j(C 3 i)/j(C(t2,£i)))- If, instead, C 31 < q EA , in the long t x limit the 
construction approaches a different curve. We sketch in Fig. 14 two possible out- 
comes of this construction. On the right, we represent a model with two correlation 
scales, ultrametricity holds between them and within each of them / is isomorphic 
to the product. On the left instead we represent a model such that dynamic ultra- 
metricity holds for all correlations below g EA . The construction approaches, in the 
long t\ limit, the broken curve depicted in the sketch. 

The SK spin-glass [104] and the dynamics of manifolds in an infinite dimensional 
embedding space in the presence of a random potential with long-range correla- 
tions [96, 36] have ultrametric decays everywhere within the aging regime. This 
scaling is also found in the trap model at the critical temperature [46]. Dynamic 
ultrametricity in finite dimensional systems has been search numerically. There is 
some evidence for it in the 4cffiA model. In 3d instead the numerical data does not 
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support this scaling [59, 111]. Whether this is due to the short times involved or if 
the scaling asymptotic is different in 3d is still an open question. 
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Figure 14: Sketch of a check of ultrametricity using the parametric plot C(t 3 ,t 2 ) 
against C(t 2 ,ti) for C(t 3 ,ti) = 0.3 < q EA fixed. On the left an ultrametric model, 
on the right a model with two correlation scales. 



11.4.2 Definition of a characteristic time 

Expanding the argument in (11.19) for t 2 = t\ + r with r <^t\ one finds, to leading 
order, 

^-1 T t(t)-( h ' {tl) Y 1 (1123) 

with O (t 2 (h' 2 (ti)/h 2 (ti) + h" (ti) / h(ti)^ corrections. The characteristic time t c (ti) 
is given by 



t c (h 



ti/a Power law 

ti I '[a ln Q_1 (*i/t )] Enhanced power law 

^i {to/ti) a Stretched exponential 

ti \n(ti/to) Logarithm 



Note that t c (ti) is defined close to the limit of equal times and (11.23) does not make 
sense for large r. Rather often in the literature, the scaling variable x = rjt\ has 
been used even for large values of r. This scaling is incompatible with the general 
properties of the triangular relations recalled in Section 11.4.1 if the exponent a is 
larger than 1 [116]. See the right panel in Fig. 13 to see the different trends of these 
scalings when plotted as functions of t/t'. 

For the power law t c (ti) scales just as t\. In the cases of the stretched exponential 
and the enhanced power law, t c (t\) has a slower growth than the linear dependence 
iff a > in the first case and a > 1 in the second. This behavior has been called 
sub-aging. For the logarithm t c (t 2 ) grows faster than linearly. This function belongs 
to a different class that we called super aging [31]. 
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Figure 15: Left: sketch of the modification of FDT in the time-domain. Right: 
sketch of the modification of fdt in the frequency domain for a glassy system, 

UJl > L0 2 > OJ3. 



11.5 Modifications of FDT 

One of the most important outcomes of the analytic solution to the mean-field glassy 
models [12, 104] is the need to modify the fluctuation-dissipation relations between 
linear responses, R(t,t w ), and their partner correlations between spontaneous fluc- 
tuations, C(t,t w ), when T < T^. In this Subsection we discuss different ways of 
presenting the modification of fdt expected in rather generic systems with slow 
dynamics. 



11.5.1 Time domain 

The fdt is a linear relation between x(t, t w ) and C(t, t w ) for any pair of times (t, t w ), 
see Eq. (7.3). In early simulations of the 3<iEA model [57] as well as in the analytic 
solution to fully-connected disordered models a modification of this relation below 
T d appeared [12]. Plotting k B Tx(t,t w ) and 1 — C(t,t w ) for t w fixed as a function of 
ln(t — t w ) one typically obtains the pair of curves schematically shown on the left 
panel of Fig. 15. The two functions go together until t — t w reaches a characteristic 
time To (tw ) and they then depart demonstrating that fdt does not hold beyond this 
time-scale. The characteristic time r (t w ) is of the order of the time needed to reach 
the plateau in the correlation function (this holds for mean-field models but it is not 
certain in finite dimensional systems). Summarizing 

t — t w < r (t w ) fdt holds in the fast scale , (11.24) 

t — t w > Tq (tw) fdt is modified in the slow scale , (11.25) 

with r (t w ) an increasing function of t w that depends on the system considered (see 
Fig. 12). 
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11.5.2 Frequency domain 

As explained in Section 5.1 taking a Fourier transform with respect to the time- 
difference while keeping t w fixed allows one to work in a mixed frequency-time 
domain. Since many experimental set-ups are prepared to apply ac-fields it is par- 
ticularly important to predict the aspect fdt modification have when using these 
parameters. The condition t — t w < To(t w ) to explore the fast relaxation roughly 
translates into u^ 1 < T (t w ), i.e. for a fixed waiting-time high frequencies are re- 
quired. The longer the waiting time the lower the frequency one has to use to see 
this scale since T (t w ) increases with t w . Instead, when t — t w > r (t w ) one has 
oj~ x > r Q (t w ), and very low frequencies are needed to explore the slow scale. These 
conditions imply 

ujTo(t w ) > 1 fdt holds in the fast scale , 

WT (t w ) < 1 fdt does not hold in the slow scale . (11.26) 

Reversing the argument above, if one weakly perturbs the sample with an ac-field of 
a fixed frequency cu 1 at a chosen time t w , one can follow the deviation from fdt using 
t w as the control parameter. This procedure yields the solid line on the right panel 
of Fig. 15. Choosing now a lower frequency u; 2 (< ^i) the crossover from the slow 
to the fast regime occurs at a larger value of t w . One obtains then the dotted curve 
on the right panel of Fig. 15. So on and so forth, the smaller the frequency of the 
applied ac-field the longer the slow regime lasts and the longer one sees deviations 
from fdt. (Note that the probe does not modify the dynamics.) In the Figure we 
chose to sketch the behavior of a system with only two-time scales, in which the 
fdt ratio takes two constant values separated at single breaking point in which the 
correlation reaches the plateau value q EA . This procedure is commonly employed 
experimentally, see Section 13.2 where we discuss the measurements of Grigera and 
Israeloff for glycerol [60]. 

11.5.3 Time-reparametrization invariant formulation 

A more interesting way of displaying the modification of the fdt has been suggested 
by the analytic solution to the mean-field models discussed in Section 12.3. One of 
its advantages is that it allows one to classify the systems into sort of "universality 
classes" according to the form the fdt modification takes. 

The analytic solution is such that, in the asymptotic limit in which the waiting- 
time t w diverges after iV — > oo, the integrated linear response approaches the limit 

lim x (t,t w )=x(C) (11.27) 
t w — > oo 
C(t, t w ) = C 

when t w and t diverge while keeping the correlation between them fixed to C [104]. 
Deriving this relation with respect to the waiting time t w , one finds that the opposite 
of the inverse of the slope of the curve x(C) is a parameter that replaces temperature 
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in the differential form of the fdt. Thus, using Eq. (11.27) one defines 

k B T EFF (C) = -(x'iC))- 1 , (11.28) 

that can be a function of the correlation. Under certain circumstances one can 
show that this quantity has the properties of a temperature [112] in the sense to be 
described in Section 14. 

One of the advantages of this formulation is that, just as in the construction 
of triangle relations, times have been "divided away" and the relation (11.27) is 
invariant under the reparametrizations of time defined in Eq. (11.10). 

Equation (11.27) is easy to understand graphically. Let us take a waiting time 
t w , say equal to 10 time units after the preparation of the system (by this we mean 
that the temperature of the environment has been set to T at the initial time) 
and trace x(Mw) against C(t,t w ) using t as a parameter (t varies between t w and 
infinity). If we choose to work with a correlation that is normalized to one at equal 
times, the parametric curve starts at the point (C(t w ,t w ) = l,x(t w ,t w ) = 0) and 
it arrives at the point (C(t — > oo,t w ) — > C,x(t —> oo,t w ) = x)- Without loss of 
generality we can assume that the correlation decays to zero, C = 0. This first curve 
is traced in red in Figs. 16. Now, let us choose a longer waiting time, say t w = 100 
time units, and reproduce this construction. One finds the green curves in Figs. 16. 
Equation (11.27) states that if one repeats this construction for a sufficiently long 
waiting time, the parametric curve approaches a limit x{C), represented by the blue 
curves. 




Figure 16: The asymptotic behavior of the integrated linear response against the 
correlation in a parametric plot, for fixed waiting time and using i as a parameter. 
Left: behavior in equilibrium. Right: behavior in a slowly relaxing system out of 
equilibrium. See text for an explanation. 

When the system equilibrates with its environment, the construction approaches 
a straight line with slope — l/(/c#T) as predicted by the fdt. This is the result shown 
in the left panel of Fig. 16. Instead, for non-equilibrium systems evolving slowly the 
asymptotic limit is different, it is given by a curve x(C). For solvable fully-connected 
models one distinguishes three families, as drawn in the right panel of Fig. 16. They 
correspond to some systems undergoing domain growth [109] (e.g. the O(N) model 
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in d = 3 when N — > oo), systems behaving like structural glasses [12, 89, 36] (e.g. 
the p-spin model) and spin-glasses [104, 96, 89, 36] (e.g. the SK model). Several 
numerical studies in more realistic models of the three cases tend to confirm this 
classification [58]. However, two provisos are in order. First, one has to be very 
cautious about the numerical results given the very short time scales and rather 
small system sizes accessible in simulations [113]. Second, as shown in Section 13.1, 
at least one system that undergoes domain growth, the ferromagnetic chain, has a 
non-trivial x(C) like the one found for the SK model. 

We have already found these asymptotic x(C) curves when we discussed the dy- 
namics of a (flat) harmonic oscillator in contact with a complex bath made of sub- 
systems with different characteristic times and temperatures (Section 7.4.4). Here 
we claim that the same structure arises in a glassy model coupled to a white-bath. 
Different values of the effective temperature are self-generated in the system. 

This plot is invariant under reparametrisations of time t — > h(t) acting on the 
two-point functions as in Eqs.(ll.lO). A different choice of the functions h only 
changes the speed with which the x(C) curve is traced but not its form. 

11.5.4 fdt part 

The formalism used in Section 7 to derive the fdt can be used to obtain a bound 
on fdt violations [105]. Indeed, one bounds the difference between response and 
variation of the correlation with the Cauchy-Schwartz inequality leading to 

< c^-d tw H(t w ) (11.29) 

where c is a constant and H(t w ) = / dqP(q,t w )(E(q) — ksTln P(q,t w )) is a positive 
definite function that monotonically decreases towards the free-energy when the 
system eventually equilibrates [70] . One finds a similar bound for Kramers processes 
and a generalization that includes the power input when time-dependent or non- 
potential forces are applied. For systems such that d t JH(t w ) — > sufficiently fast 
when t w — > oo the bound implies that the lhs vanishes in this limit. This can be 
achieved in two ways: either each term is finite and the difference between them 
vanishes or each term tends to zero independently. The former possibility is what 
happens in the fast regime where fdt holds. The latter holds in the slow regime 
where both the response and the variation of the correlation are very small but the 
relation between them does not follow fdt. One derives a more useful bound by 
integrating (11.29) over time: 

\k B T x (r + t w ,t w ) -C(r + t w ,t w )+C(t w ,t w )\ < c f ^ dt' y/ 1 -d t ,H(t>) . (11.30) 

J t w 

The terms in the lhs are now always finite while the value of the RHS depends on 
the relation between the time-difference r and the waiting-time t w . For sufficiently 
short r such that the RHS vanishes fdt has to be satisfied in its integrated form. 
This result explains the existence of a common straight-line with slope — l/(/cgT) 
in the nonequilibrium curves in Fig. 16. For sufficiently long r such that the RHS 



k B TR(r + t w , t w ) - d s C(r + t w , s) \ 
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takes a finite value fdt can be violated. In this second scale a departure from the 
straight line of slope —l/(k B T) can occur and it is indeed what happens in systems 
with slow non-equilibrium dynamics, see the right panel in Fig. 16. One sees how a 
separation of time-scales in the dynamics influences the fdt violations. 

In driven systems the bound depends on the power input and only vanishes in 
the limit of vanishing applied forces. The fdt is not even enforced in the fast scale 
and deviations start as soon as C decays from 1. However, as we shall see below, the 
modification of FDT follow a very similar pattern to the one shown in Fig. 16 with 
the strength of the applied force playing a similar role to the one of the waiting-time 
here. 

11.5.5 Diffusion 

In these Lectures we focus on models with a bounded self-correlation for an observ- 
able with zero average that is normalised at equal times. If the averaged observable 
does not vanish but the equal-time correlation reaches a time-independent limit one 
can still use the simple self-correlation in the generalisations of fdt. However, in 
more general diffusive model with an unbounded time- dependent equal-time corre- 
lator it is more natural to compare the behaviour of the "displacement" A(t,t') = 
C(t,t) + C(t',t') — 2C(t,t') (that vanishes by definition at equal times) to the lin- 
ear response. In normal diffusion these are linked by R(t,t') = l/(2k B T)A(t,t'). 
In glassy models like the massless manifold in a random potential and others this 
relation is modified [36, 37, 71, 164]. 

12 Solution to mean-field models 

In this Section we turn our attention to the solution to the Schwinger-Dyson equa- 
tions derived in previous Sections. We start by describing the simplest numerical 
algorithm that solves these equations and we next briefly discuss the asymptotic 
analytic solution at high temperatures. Next we describe in quite detail the solution 
at low T. 

12.1 Numerical solution 

One can attempt a numerical solution to the set of causal integro-differential equa- 
tions (9.16), (9.17) together with the equation for the Lagrange multiplier fi(t). One 
of the questions we would like to explore is whether they encode a non-equilibrium 
evolution as the one described in the Introduction and Section 2. 

The correlation C(t, t') and response R(t, t') are two-time quantities, that is, they 
depend on t (which physically corresponds to the time of observation) and t' (which 
corresponds to the age of the system). In the simplest algorithm one discretises 
the two-times plane with a uniform grid, t' = j5 and t = i5. The correlation and 
response on the diagonal and the next-to-main diagonal of the two-times plane (i, j) 
are known, see Eqs. (9.41) and (9.42), for all times. 
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The time-derivatives <9 2 C(t,t') and d 2 R(t,t') in their discretized form are used 
to update the two-point functions. Due to causality, to advance one time step, the 
integrals only need values of C and R that are already known. This algorithm is 
simple and efficient but it is severely limited by the computer storage capacity. Since 
one has to store C and R for all previous time steps, the memory used grows as i 2 
and this number becomes rather quickly prohibitive. In standard PCs one can use 
Imax ~ 10 4 , get an acceptable precision for S < 0.1 and reach total times of the order 
of 10 3 . 

In the quantum case the presence of non local kernels rj and z/, that appear 
convoluted with C and R, renders the numerical solution harder. The larger the 
cut-off A, the smaller the iteration step 5 we need to compute these integrals with 
a good precision. The maximum total time is of the order of 10 2 in this case. 

A different starting point for a numerical solution is the single variable equation 
(9.56). This route was followed by Eissfeller and Opper for spin-glasses [114] and it 
is usually used in the so-called dynamic mean-field theory [91]. Again, this method 
is limited by the storage capacity. 

The knowledge of the qualitative features of the solution helps one devising a 
more performant algorithm with a variable two-time grid. As we shall see from the 
analytic solution, C and R vary rapidly when times are near the diagonal j = i and 
decay very slowly far from it. Kim and Latz have exploited this property and wrote 
such an algorithm for the spherical p spin model reaching total times of the order 
of 10 8 [110]. 

Finally, one can think of an iterative search where one starts from a trial form of 
C and R and uses the dynamic equations to extract the new form. One can expect 
to obtain the solution by repeating this procedure until the iteration converges to 
a fixed point. This method would allow one to look for solutions of the full set of 
Schwinger - Dyson equations that break causality. 

The numerical solution for the causal problem, found with the simple uniform 
grid, has been of great help in deriving the asymptotic analytic solution. In the 
following we describe how this solution builds up. 

12.2 Solution at high temperatures 

At high temperature the system equilibrates with its environment since 

t EC i(N — > oo, T) = finite . (12.1) 

The mere existence of an asymptotic limit implies that one-time quantities as, e.g., 
the energy density, £(t), or the Lagrange multiplier, /i(t), have to approach an 
asymptotic limit, lim^oo £{t) = and lim^oo /i(t) = jj,^. In equilibrium = S m 
and similarly for all one-time quantities. Two time-quantities, as C and R, depend 
on times but only through time differences as explained in Section 6. 

To solve the high T dynamics one first assumes that after a transient equilibrium 
is reached and a solution of the form /i(t) — > /i^, 

C(M') ->C ST (t-t / ) , R(t,t') -> R ST (t-t') (12.2) 
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with R ST and C| scst related by fdt, for long waiting-times t' and all time-differences 
t — t' : exists. These properties also apply to D and £ that behave as a correlation 
and a response, respectively. This Ansatz should solve Eqs. (9.16) and (9.17) when 
T > T d , with T d the dynamic critical temperature. In order to prove it we take t' 
long and we assume that we can separate the integrals in Eqs. (9.17) and (9.16) in 
a preasymptotic and an asymptotic contribution, 



fOO rt E Q poo 

/ dt" ■ ■ ■ « / dt" ■■■ + dt" ■■■ . (12.3) 

Jo Jo Jt Eq 

Next, we assume that the two-point functions decay as fast as to ensure that all 
preasymptotic contributions vanish, e.g. Jq eq dt" A(t,t")B(t' ,t") ~ when t! and 
t > t' are in the asymptotic regime. Using the Ansatz (12.2) and this assumption 
the integrals in the RHS of Eq. (9.17), for a classical problem, read 



/ 

■It, 



feQ v ' k B T dt" Jt m k B T dt" 

1 ^ d rn u ^ ul ^ , 1 ft ^„ dD ST (t - 1" 



■g j 1 *" w-c - oa - Ol h- ^ | *" cwf - 

The first integral in the RHS is a total derivative and it can be readily evaluated, it 
yields D ST (t — t')C ST (0) — D ST (t — t m )C ST (t' — t m ) D st (t) where we assumed that 
t and t! are well in the asymptotic regime in such a way that C ST (t' — t EQ ) ~ 0, and 
we defined r = t — t'. Integrating by parts the last integral in the RHS one finally 
obtains the high T equation for the correlation 

G-\t)C, t {t) = -i- J D ST (0)C ST (r) - -L f dr' D ST (r - r')d r ,C^r ! ) (12.4) 
kb J- ks-L Jo 

with G~ 1 (t) = Md T 2 + ^d T + //qo- One can check that Eq. (9.16) coincides with 
Eq. (12.4) under the same assumptions. To prove this statement one has to integrate 
Eq. (9.16) with respect to t' from t EQ to t' taking care of the fact that t' appears in 
the lower limit of the integral. 

Equation (12.4) for the spherical p spin model coincides with the schematic MC 
equation [98, 115]. This equation has a decaying solution above a sharp critical 
temperature that we call T MCT = where the assumptions of tti and fdt are 
justified. After a short transient (eliminated by the limit t' ^> t EQ ) the system 
equilibrates with its environment even if the thermodynamic limit has already been 
taken. At very high T the decay to zero is very fast and typical of, say, a high-T 
liquid. Closer to T d , however, a very interesting structure appears. The solution 
takes the form sketched in the left panel in Fig. 12. In a logarithmic scale one 
sees a two step relaxation develop with a first relatively quick decay towards a 
plateau at a value that we call q EA and next a slower relaxation towards zero. The 
length of the plateau increases when temperature approaches Td from above and it 
diverges at T d . At T d the height of the plateau, q EA , follows from the asymptotic 
analysis of Eq. (12.4). If one loosely considers q EA to be an order parameter, the 
high temperature analysis yields q EA > [see Eq. (12.30)] and the transition is 
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discontinuous. It is important to stress that, as we shall see below, this does not 
mean that the model has a first order thermodynamic transition. All susceptibilities 
are continuous when going across T d even though q^ A > 0. In the mode-coupling 
literature these transitions are called type B. 

The details of the asymptotic analysis of the schematic MC equation and its rela- 
tion with the behavior of real systems has been discussed at length in the literature 
(see, e.g. [115]). We shall not develop it here. With the purpose of future compar- 
ison with the low-T solution we just recall that the approach and departure from 
the plateau (beta relaxation) occurs with two power laws: 

Cst(t) ~ qt + c a r~ a + ... C st (t) ~ qi, - c b r b + ... (12.5) 

given by 

i r 2 (i + &) i r 2 (i-q) _i v w (gj) . . 

k B T d T(l + 2b) k B T d T(l-2a) 2 (V"«))^ ' 1 ] 

A similar analysis can be done for a quantum model. 



12.3 Solution at low-T 

Three families of mean-field models have been found so far. In this Section we 
present the solution to the spherical mean-field descriptions of ferromagnetic domain 
growth and structural glasses in some detail. We use a generic notation that allows 
us to treat the classical and quantum problem simultaneously. The presentation 
follows [85]. By the end of this Subsection we discuss the generalisation of these 
results to models of "spin-glass" type, models with spatial dependence and the effect 
of different microscopic dynamics. 

The numerical solution to the dynamic equations at low T shows no evidence for 
an arrest in the waiting-time dependence of the decay of C and R. In this regime 
of temperatures, 

t m (N,T<T d ) ^oo (12.7) 

and the equations do not admit the choice of a t' > t m . In order to consider the 
crossover towards the equilibration regime one should revisit the derivation of the 
dynamic equations allowing for N finite. This program has not been pursued in the 
literature and it remains one of the most interesting open problems in the field. 

12.3.1 The Lagrange multiplier 

We approximate the integral in Eq. (9.21) by separating its support in three intervals 

t":0^5 , t":5 ^A t , t":A t ^t. (12.8) 

The first time-interval contains only finite times t" . Hence, all correlations and 
responses of the form C(t,t") and R(t,t") vanish due to Eqs. (11.3) and (11.7). 
In the last time-interval t" is close to t in the sense that correlations of the kind 
C(t, t") are of the form C ST (t — t") + q EA and similarly for the responses. Finally, in 
the intermediate time-interval the C and R vary in the aging regime. Of course, we 
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are sloppy in that we do not precise what are the values of Sq and A t . The definitions 
of correlation scales given in Section 11.4 correct this imprecision exchanging the 
time limts by limits in the correlation. Within these assumptions the asymptotic 
value of fj,(t) is given by 

roo _ roo 

Hoc = 4x> + <7ea/ dr' S ST (r') + D qEA / dr'i? ST (r') 
Jo Jo 

roo 

+ dr'[ S ST (r')C ST (r') + D ST (r')i2 ST (r / ) ] + Last (12.9) 
Jo 

(see Appendix E). £ and D are made of two terms, one contribution from the 
bath and one contribution from the interactions (see Eqs. (9.39) and (9.40)). We 
called Last a term that equals — M 9^C st (t)\ in a model with inertia (classical 
or quantum) and simply ksT in classical models without inertia. is the aging 
contribution: 

A^ = lim f dt" [ E AG (t, t")C AG (t, t") + D AG (t, t")R AG (t, t") } . (12.10) 

The bath does not contribute to the integrals in Aoo when the kernels 77 and v decay 
sufficiently fast to zero as to yield vanishing integrals. This is trivially true for a 
white noise. It can be a working assumption for colored noises based on a weak limit 
of the strength of the coupling to the noise (see, however, [118]). More precisely, we 
are neglecting terms of the form lim^oo J* * dt" A(t — t")B(t,t") where A is either v 
or i] and B is either C AG or R AG . In this case 

Aoo = lim /* dt" \ S AG (t, t")C AG (t, t") + D AG (t, t")R AG (t, t") 1 . (12.11) 

t^oojQ L J 

The second and third terms in Eq. (12.9) come from the constant (non-zero) limit 
of the first decay of the correlation q EA = liim-t^oo linty C(t, t') and the ver- 
tex D qEA = limt-^-Kx, limt/^oo D(t, t'). For the classical spherical p spin model 
Dq EA = I <?ea 1 an d this equation also holds for its quantum extension if we use 
lim^oo R S t(t) q E A, a property of the wltm scenario. The integral over the sta- 
tionary parts can be simply performed using fdt for classical problems but they 
cannot in quantum problems. 



12.3.2 The stationary regime 

If (t,f) are such that C(t,f) > q EA , C(t,t') = q EA + C ST (t - t') and R(t - t') = 
R ST (t — t'). The Schwinger-Dyson equation for R in this time sector reads 

(McP + /i^) R ST (r) = 8(t) + £ dr' S ST (r - r')R ST (r') (12.12) 

and it keeps the same form as in the high-temperature phase, apart from the fact 
that the constant yt,^ has contributions from the aging regime. The Schwinger-Dyson 
equation for C reads 

(M8 2 t + /too) {q EA + C ST (r) ) = + g EA J dr' S ST (r') + D qEA J dr' R ST (r') 

/oo 
rfr' [S ST (r + rOCs^r') + L> ST (r + t')R st (t')] . (12.13) 
-00 
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One can now Fourier-transform both equations 

(-Ml? + /ioo) C st (cj) + /ioog EA 5(^) = (^4oo + g E AS ST (w) + -D gEA -R ST (w)) 5(^0 

+S st (^)C st (cj) + D ST (^)i? ST (-^) . 

The formal solution to the equation for C ST is 

/^ooQea "I" ^-oo "I" Qea^st 

The first term on the RHS has an imaginary and a real part. The imaginary part 
vanishes identically since, due to fdt, both IhlR st (cj) and ImE ST (o;) are propor- 
tional to tanh ((3hu/2) which is zero at uo = for classical and quantum problems. 
Concerning the real part of this first term, as we have assumed that C ST (r) goes to 
zero for r — > oo, we need to impose the self-consistent condition 

-fiooq EA + + g EA S ST (cu = 0) + D qEA R ST (ou = 0) = . (12.14) 

This is the condition that fixes q EA . We shall find it again in the next section as the 
matching condition between the stationary and aging regimes. The final equation 
for C ST (u) is 

C ST (cu) = D ST (co)\R ST (u)\ 2 . (12.15) 

One can check that these calculations are consistent with the results from fj,^. 
Actually, the integrals in equation for /i(t) involving the stationary parts can be 
evaluated with the help of the equations for R ST and C ST , Eqs. (12.14) and (12.15), 
and yield once again Eq. (12.14). 

Similarly to the high-temperature case one can now show that fdt for S ST and 
D ST implies fdt for R ST and C ST . The remainder of the proof, i.e. to show that 
fdt between R ST and C ST implies fdt between S ST and D ST depends only upon the 
form of S ST and D ST as functions of R ST and C ST and is not modified from the one 
discussed in Section 12.2. 



12.3.3 The aging regime 

If we now choose the times t, i! to be well-separated so as to have C(t, t') = C AG (t, t') < 
g EA and R(t,t') = R AG (t,t'), the web and wltm hypotheses allow us to throw the 
second time derivatives on the lhs. We assume that their contribution is much 
weaker than the one of each of the integral terms on the RHS. This is an assumption 
that we have to verify at the end of the calculation, once the solution for C AG and 
R AG is known. It corresponds to the over-damped limit. 

Using the approximation described in Appendix E, the equation for R in the 
aging regime becomes 

_ roo poo 

HooR AG (t, = £ag(*, / dr'R ST (r') + R AG (t, f) / dr' S ST (r') 

Jo Jo 

+ / ^ rf^"s AG (^,t") J RAo(^ , ^^ , ) (12.16) 
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and we call it the -Rag-^Q- Similarly, the equation for C becomes 

POO „ poo 

VooC AG (t, t') = C AG (t, t') / dr'E ST (r') + D AG (t, t') / dr'R ST (r') 

Jo Jo 

+ f dt"t AG {t,t")C AG {t",t') + f dt" D AG {t,t")R AG {t',t") (12.17) 
Jo Jo 

and we call it the C AG -eq. In all integrals over the slow regime we neglected the 
contributions of the noise kernels r\ and v and we approximated S AG (t, t') ~ X AG (t, t?) 
and D AG (t,t') ~ D AG (t,t') (again, see [118] for a discussion on the effect of a strong 
bath). 

12.3.4 The Edwards-Anderson parameter 

The Edwards-Anderson parameter, q EA , is determined self-consistently from the 
matching of lim^oo C AG (t, t) = lim^/^oo lim^oo C(t, t') = q EA . Taking the limit 
t' — > t~ in the _R AG -eq and C AG -eq one obtains 

f^ooR AG (t,t) = S AG (t,t) / dr' R st (t') + R AG (t,t) / dr' E ST (r') , (12.18) 

/•oo _ roo 

Aoo + q EA / dr' S ST (r') + D AG (t : t) / dr' i? ST (r') . (12.19) 
jo jo 

The first equation admits the solution R AG (t, t) = since S AG (t, i) is proportional 
to R AG (t,t) - see Eq. (9.39). This corresponds to the high-temperature solution 
where there is no aging regime. Here we concentrate on the other possibility. The 
response becomes smaller and smaller as time passes - though its integral over 
an infinite interval gives a finite contribution. If we neglect all terms that are 
proportional to R AG (t, t) with respect to terms that are proportional to q EA , only the 
first term in the power expansions of X and D survive and 

(t/R) ee lim A* = D AG (t, t) (12.20) 

V Mea t-»oo R AG [t, t) 

that for the p spin model become 

{m) qEA = C- 2 D qEA = \ C" 1 , (12.21) 

in accord with the large r limit of the stationary values (see Section 12.3.2). Equa- 
tions (12.18) and (12.19) become 

f* OO P OO 

/ioo = (t/R) / dr' R ST (r') + / dr' S ST (r') , (12.22) 
v ' qea Jo Jo 

/ioog EA = A^ + q^ dr' Z ST (r') + D qEA dr' R ST (r') . (12.23) 

jo jo 

The second equation is the same as the one arising from the end of the stationary 
regime, Eq. (12.14). 
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From Eqs. (12.14) and (12.15) one derives 

1 

dr R st (t) = R ST (cu = 0) = , (12.24) 

Hoc — ^stI^ — UJ 

and 

1 = (t/R) R 2 ST (u = 0) . (12.25) 

We remind that the factor R 2 T {u) = 0) can be written in terms of the stationary 
correlation function using FDT; therefore this is a closed equation for the correlation 
that determines q EA . In the case of the p-spin model it reads 

In the classical case, the integral can be readily computed and the final equation for 
<? EA is 

^tF^ C~ 2 (l " & A ) 2 = (ksTf , (12.27) 

that coincides with the result for the purely relaxational dynamics [12]. For p > 3 
fixed, q EA is a function of temperature. Equation (12.27) can be solved graphically. 
The lhs has a bell shape. It vanishes at q EA = 0, 1 and it reaches a maximum at 
Qe'a* = (p ~~ 2)/p- The equation has two solutions for all temperatures (/c#T) 2 < 
(k B T MAX ) 2 = p(p - l)/2 [{p - 2)/p] p ~ 2 (2/p) 2 , these merge ar T max and disappear 
for higher T's. The physical solution corresponds to the branch on the right of the 
maximum, the one that continues the solution q EA = 1 at T = 0. The minimum 
value of q EA is reached at the dynamic critical temperature T d (< T MAX ), where q£ A = 
q EA {T d ) > q E 



-.MAX 

/ea • 



12.3.5 Fluctuation - dissipation relation 

In order to advance further we have to relate the response to the correlation. If we 
assume that 

^'^T- < 12 ' 28 > 

with T* the value of an effective temperature (see Section 14) that is determined by 
Eqs. (12.23) and (12.24) = - ^ =0) + D qEA R ST (u = 0). Using Eq. (12.28) and 

the equivalent relation between E AG and D AG , we obtain = (/c B T*) _1 lim^oo (^D AG (t, t)C AG (t, tfj 

(k B T*)~ l q EA D qEA and 



(P 2) -i? ST (cu = 0) = 



Ca P/2 • (12-29) 



/••///' ' q a ! \ pip - 1) 

In the classical limit T/T* — (p — 2)(1 — q EA )/q EA and the result in [12] is recovered. 
Note that both in the classical and quantum case, T* — > oo if p = 2. Since the 
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case p = 2 is formally connected to ferromagnetic domain growth in d = 3 (in the 
mean-field approximation) there is no memory neither in the classical nor in the 
quantum domain growth. 

The Ansatz in Eq. (12.28) solves classical and quantum aging equations. The 
modification of the fdt in this regime became thus classical even when quantum 
fluctuations exist. This is an interesting sort of decoherent effect that will become 
clearer when we shall discuss the interpretation of this results in terms of effective 
temperatures. 

Using Eq. (12.28) for all values of C below q EA we assumed that there is only one 
aging correlation scale in the problem. Interestingly enough, one do a more general 
analysis using the formalism described in Section 11.4 and find that the dynamic 
equations force the solution to have only one aging correlation scale [78] . 



12.3.6 Discontinuous classical transition 

The classical dynamic critical point (T d , h — 0) can arise either when q EA — > or 
when T* -> T. For the p spin model, using Eqs. (12.27) and (12.29) the latter holds 
and [12] 

(k B T d ) - 2(p _ 1)P -i (12 - 30) 

The transition is discontinuous since the order parameter q EA jumps at T d . However, 
it is still of second order thermodynamically since there are no thermodynamic 
discontinuities, all susceptibilities being continuous across T d . For instance, 

lim x(Mtu) = TrW - <?ea) + t4^?ea -»• T^7f when T -> T* at T d . (12.31) 
kb-L Kb-L KbI 

The dynamic transition occurs at a value T d that is higher than the static transi- 
tion temperature T s . The latter is fixed as the temperature where replica symmetry 
breaking occurs (using the standard prescription to fix the parameters in the Parisi 
Ansatz to compute the free-energy density) [167]. This feature is an explicit reali- 
sation of the discussion on T g and T in Section 2 They are sharp in this model. 



12.3.7 The classical threshold level 

The asymptotic energy density reads = -± J °° dt"[E(t, t")C(t, t")+D(t, t")R(t, t")} 
where we used Eq. (9.24). Replacing the solution found above we obtain 

= £ TH . (12.32) 

If one compares this expression with the equilibrium energy density, found studying 
the partition function [167], one discovers that [12] 

£oo = £th ^* ^eq • (12.33) 

Thus, the non-equilibrium dynamics does not approach the equilibrium level asymp- 
totically but it reaches a threshold level that is extensively higher than equilibrium 



f — 



(i - qL) + 
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(note that the inequality (12.33) holds for the energy density). The name threshold 
is motivated by a similarity with percolation (in phase space) that we shall discuss 
in Section 15 [12]. 

12.3.8 Two p models 

In Section 12.3.4 we took the limit t' — > t~ , or equivalently, C AG — > q~ A in the 
equations for the slow part of the response and the correlation and this lead us to 
Eqs. (12.25) and (12.29) for q EA and T*. Let us now take subsequent variations of 
this equation with respect to the correlation and evaluate them in the same limit. 
It is easy to see that if we neglect the contributions from the integral between t' 
and t, assuming that the integrands are analytic in this limit, we get new equations 
linking T* and q EA that, for generic models, are not compatible. Indeed, as we shall 
see below, the pure spherical p spin model is the only one for which the solution is 
given by an analytic function j^(x) when x — > 1~. 

The way out of this contradiction is to propose that the correlation approaches 
the plateau at q EA with a power law decay and that it departs from it with another 
non-trivial power law [89, 36]: 

C ST (t-i') = (l-feO+cWfi-t'r + 4 2) (*-«r 2 " + (12.34) 

with and constants. If the exponent b is smaller than one, the integrals 
generated by taking derivatives with respect to C AG do not vanish when t! — > t~ . 
The expansion of the stationary and aging equations around q EA fix the exponents 
a and b. One finds [89] 

i (r(i + fe)) 2 = i (r(i-q)) 2 = i v w (g EA ) , 6 

k B T*T(l + 2b) k B TT(l-2a) 2 (V"(g EA )) 3 / 2 1 ' ' 

that are to be confronted to Eqs. (12.5) and (12.6) for the high T behavior. We 
recall that V(C) is the correlation of the random potential. Importantly enough, 
the exponents a and b are now T-dependent and they are related via an equation in 
which T* enters. 

Classical spherical p spin model 

Since V(C) = C p /2 using Eqs. (12.25) and (12.29) to fix T* and q EA one finds 
(r(l + b)) 2 /T(l + 2b) = 1/2 and b = 1 for all T <T d . The exponent a interpolates 
between a = 1/2 at T -> and a = 1 at T -> T d since (r(l - a)f/Y{l - 2a) = 
T/(2T*). 

Classical mixed p 1 + p 2 spherical spin model 

For adequate choices of the coefficients in V(C) = a 1 /2C Pl + a 2 /2C P2 (see below) 
one finds T-dependent exponents a(T) and &(T). 

Ultrametric limit 
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It is interesting to notice that (T(l + b)) 2 /T(l + 2b) is bounded by one. Thus, 
Eq. (12.36) constrains the random potentials for which a solution with only two 
correlation scales exists. For a particle in a power-law correlated random potential 
one sees the transition towards an ultrametric-like solution arrives when the potential 
goes from short-range to long-range correlated [89]. To our knowledge this has not 
been found in a static calculation. An interpretation of the exponents a and b, and 
this consequence, in terms of the properties of the tap free-energy landscape is not 
known either. 

12.3.9 SK model and similar 

A different family of models, to which the SK model belongs, are solved by an 
ultrametric Ansatz, C31 = /(C32, C21), for all correlations below q EA . The x{C) plot 
yields a non-trivial curve (instead of a straight line) for C G [0, q EA \. The transition 
is continuous q FA = 0. These models are called type A in the mct literature. 

Indeed, for a generic disordered model with random potential correlated as in 
Eq. (9.3), one finds that the solution is ultrametric if and only if [89] 



This bound constrains, for instance, the values of the coefficients in a polynomial 
random potential for which the dynamic solution is ultrametric. The fdt is modified 
with a C dependent factor given by T/T EFF (C) = q EA V"(C)^V"(q EA )/(4(V"(C)) 3 / 2 ). 

12.3.10 Mode dependence 

The models we solved so far have no spatial dependence. The manifold problem (2.8) 
has an internal structure that leads to a mode- dependence. This model has been 
solved for generic potential correlations [36]. We summarize the outcome without 
presenting its detailed derivation. All modes are slaved to one in the sense that one 
has to solve for the dynamics of one of them and the mode- dependence follows from 
an algebraic equation. The value of the effective temperature does not depend on 
the mode. The mathematical reason for this is the slaved structure of the equations. 
The physical reason is that all interacting observables evolving in the same time- 
scale have to partially equilibrate and acquire the same effective temperature (see 
Section 14). The height of the plateau, q EA , is a k dependent quantity. The approach 
to it and departure from it also depends on k but only via the prefactors; the 
exponents a and b, see Eqs. (12.34) and (12.35, are the same for all modes. 

Mode-couling equations including a wave-vector dependence have been derived 
by Latz using the Mori-Zwanzig formalism; the structure of the solution to these 
equations shares the properties just described [102]. 

12.3.11 Quantum fluctuations 

The simplest effect of quantum fluctuations is to introduce oscillations in the first 
step of relaxation. These disappear at long enough time-differences and they are 




(12.37) 
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totally suppressed from the second decay, that superficially looks classical [85, 106]. 

The Edwards-Anderson parameter q EA depends upon T and h. As expected, 
quantum fluctuations introduce further fluctuations in the stationary regime and 
they decrease the value of q EA , q EA (T, Ti 7^ 0) < q EA (T, h — > 0). 

The modification of FDT in the quantum model is of a rather simple kind: R AG 
and C AG are related as in the classical limit. For the quantum extension of the p spin 
model there are two correlation scales, one with the temperature of the environment, 
T, the other with another value of the effective temperature, T*, that depends on 
T, h and the characteristics of the environment. This is a kind of decoherent effect. 

As regards to the transition from the glassy to the liquid or paramagnetic phase, 
an interesting effect appears. Keeping all other parameters fixed, the plane (T, T = 
h 2 /(JM)) is separated in these two phases by a line that joins the classical dynamic 
critical point (T^,F = 0) and the quantum dynamic critical point (T = 0,1^). 
Close to the classical dynamic critical point the transition is discontinuous but of 
second order thermodynamically until it reaches a tricritical point where it changes 
character to being of first order. This behavior is reminiscent of what has been 
reported for the quantum spin-glass studied in [14]. 

A still more dramatic effect of quantum mechanics is related to the very strong 
role played by the quantum environment on the dynamics of a quantum system. 
Indeed, the location of the transition line depends very strongly on the type of 
quantum bath considered and on the strength of the coupling between system and 
environment [118]. 

12.3.12 Driven dynamics 

The effect of non potential forces can be mimicked with a force as the one in (2.7) [18, 
19] where the strength of the force, a, is analogous to the shear stress a. For 
strengths that are not too strong, the dynamics presents a separation of time scales 
with a fast approach to the plateau and a slow escape from it that is now, however, 
also stationary. Indeed, after a characteristic time t m the full dynamics becomes 
stationary though the system is still far from equilibrium. One defines a structural 
relaxation time, T a , as the time needed to reach, say, a correlation equal to a half. 
One relates the structural relaxation to the viscosity via rj = J dtC(t). The scaling 
of i] with the shear rate 7 = a/rj has been successfully confronted to the behavior 
in rheological experiments in super-cooled liquids and glasses [19]. In terms of the 
general scalings discussed in Section 11.4, the correlations are characterised by two 
different functions j, one for the fast decay towards the plateau and another for the 
slow decay from the plateau, while the functions h(t) are simple exponentials. 

Interestingly enough, from the study of fdt violations above (though close to) 
and below T d) when the forcing is weak, one extracts a still well-defined slope of 
the x(C) plot when C evolves in the slow scale [18, 121, 19]. This means that an 
effective temperature can also be identified for these systems kept explicitly out of 
equilibrium (see also [172]). 

Oscillatory forces, as the ones used to perturb granular matter, have a different 
effect. Aging is not stopped in a finite region of the phase diagram (T-strength of the 



86 



force-frequency of the force) [26]. An effective temperature can still be defined as the 
slope of the x(C) plot drawn using stroboscopic time, with a point per oscillatory 
cycle. 

13 Modifications of FDT in physical systems 

In this Section we discuss the realizations of the modifications of fdt in each of the 
physical systems presented in Section 2. 

The asymptotic curves in Fig. 16 have a rather peculiar form. They are linear 
with slope —l/{k B T) when the correlation decreases from 1 to the plateau value 
q EA . After this breaking point, when the correlation decays towards zero, the curve 
is non-trivial, taking the three forms described in Section 11.5.3 for ferromagnetic 
domain-growth (in d > d c ), structural glasses and spin-glasses. The separation 
between these two parts is sharp when the dynamics has a sharp separation of time- 
scales. In Section 11.5.4 we gave a formal explanation for the existence of the first 
scale where fdt holds for any relaxing system. Here and in the two next Subsections 
we give more intuitive arguments for the validity of fdt in the fast regime in the 
context of the physical systems discussed in the Introduction. 

For the sake of comparison we show in Fig. 18 the form of the x(C) plot for a 
p spin model adapted to mimic a structural glass (the original model), a sheared 
liquid or glass, vibrated granular matter and a quantum glass. 

13.1 Domain growth 

The separation of time-scales is easy to visualize in the case of a system undergoing 
domain growth. If the two times t and t w are not very different, the domain walls 
do not move between t and t w and the dynamics consists of spin flips within the 
domains due to thermal fluctuations. This dynamics is identical to the equilibrium 
dynamics since the system can be thought of as being a patchwork of independent 
equilibrated finite systems of linear size TZ(t w ). It is then natural that the fdt holds 
in this time scale. On the contrary, if t grows in such a way that r becomes of the 
order of TZ(t w ), the domains grow and the non-equilibrium dynamics takes place. 
The motion of the domain walls in the presence of an external perturbing random 
field introduced to measure the staggered response is due to two competing factors: 
on the one hand, the system tends to diminish the curvature of the interfaces due to 
surface tension, on the other hand the random field tends to pin the domain walls 
in convenient places. The full response of the walls is approximately [119] 

Xi{t + t w , t w ) « p(r + t w )x s {r + t w , t w ) w 7£ _1 (r + t w )x s (r + t w , t w ) (13.1) 

where p{j+t w ) is the density of interfaces and Xsij+twi t w ) is the integrated response 
of a single wall. The contribution of a single interface depends on dimensionality and, 
for a ferromagnetic Ising model with first neighbor interactions and non-conserved 
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order parameter it has been estimated to be 



Xsij~ ~l" t w , t w ) t 



—a 



with a = 



(3 - d)/4 d < 3 
d > 3 



and 0.33 + 0.066 In r in d = 3 [119]. Thus, below the critical dimension d c — 3 the 
response of a single interface grows indefinitely with the time-difference. The same 
trend though with a different value of d c and with slightly different exponents has 
been obtained for a continuous spin model. Still, for all d > 1, p decays sufficiently 
fast as to compensate the growth of Xs, Xi vanishes and the integrated linear response 
function gets stuck at the value reached at the end of the stationary time scale, 
Xeq = (k B T)~ l {\ — m^). In the slow regime the parametric plot is then given by 
a flat straight line with vanishing slope, see the dashed line in the right panel of 
Fig. 16. Instead, the case d — 1 behaves in a totally different way: p(r + t w ) still 
decays as (r + t w )~ l l 2 while Xs grows as r 1 / 2 , thus, in the regime of times such that 
r/t w is finite the interfaces do contribute to the integrated response and the x(C) 
curve is non-trivial. As explained in [119] these results can be easily interpreted as 
follows. When d > d c the curvature driven mechanism dominates and the interface 
response decreases with p. When d < d c instead this mechanism is weaken while 
the field driven motion, and consequently the single interface response, become 
more important. In the limit d — 1 the curvature driven mechanism disappears, Xs 
compensates exactly the decay in p and xi is non-trivial [119]. 

Besides the qualitative arguments just presented, the ferromagnetic Ising chain 
is completely solvable and very instructive [170, 120, 48]. The transition occurs 
at K — J/iksT) — > oo and this limit can be reached either by letting T — > or 
J — > oo. The latter is better adapted to compute the integrated linear response and 
one finds 



The fast regime is eliminated for this choice of parameters and the full x(C) curve 
is given by this equation. This model is a concrete example of a system undergoing 
domain growth that has a non-trivial x{C)- For finite J (or finite T) the equilibration 
time is finite and, for t w > t m the trivial xiP) = 1/(^b^) must be reached. However, 
for fixed t w < t m one still finds a very rich structure: the master curve x{C) 
corresponding to J — > oo is followed from C(t w ,t w ) = 1 down to C m = C(t EQ ,t w ). 
For longer time-differences, r + t w > t EQ the system equilibrates and x(C) departs 
from the master curve and approaches the point (0, l/(ksT)). The point of departure 
C EQ depends on J and t w . For fixed t w , C m increases with increasing J; for fixed J, 
C EQ increases with increasing t w . Corberi et al also argued that even if the form of 
C and R depend on the microscopic dynamics, the x(C) curve should be universal. 

Note an unexpected feature of this result: when J — > oo, even if the correlation 
and response vary in a single time-scale with a simple aging scaling, the x{C) relation 
is a continuous function. This property poses some problems for the interpretation 
of the slope of the x(C) plot as an effective temperature (see Section 14) as well as 
the relation between statics and dynamics discussed in Section 13.10. It would be 
interesting to identify the generic origin of these "contradictions". 




(13.2) 
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For some time it has been argued that systems undergoing domain growth cannot 
have a non-trivial x(C). This example, even though in d = 1, demonstrates that 
this is not true. It would be extremely interesting to construct a coarsening model in 
higher dimensions with a non-trivial contribution to the integrated response coming 
from the interfaces in such a way that x{C) be non-trivial. 

13.2 Structural glasses 

For glassy systems, where no such growth of order has been identified yet, the form 
of the fdt modification is different from the one found for domain growth. These 
systems still show a separation of time-scales in the sense that the correlation decays 
in two sharply separated steps as suggested by numerical studies. The asymptotic 
parametric curve has the form of the solid line in Fig. 16. One can argue in terms of 
cage motion to get an intuitive interpretation of why FDT holds in the fast correlation 
scale. Indeed, in this correlation-scale the time-different t — t w is so short that 
each particle moves within a rather "solid" cage formed by its neighbors. Loosely 
speaking, the cages act as a confining potential on each particle. The rapid motion 
is again due to thermal fluctuations and the dynamics is like the one expected in 
equilibrium: it is then no surprise that FDT holds. For the moment there is no 
easy interpretation for the form of the second part of the parametric curve. Why 
does it have a non-zero constant slope or, equivalently, a single finite value of the 
effective temperature? This result was obtained using fully-connected models and 
it was later checked numerically in a number of more realistic glassy models [58]. 

Two sets of experiments using laponite [61] and glycerol [60] have investigated 
the modifications of fdt in glasses. The former is explained in [61]. In the latter 
Grigera and Israeloff [60] monitored the time-evolution of the FD ratio for glycerol 
at T = 179.8 K, the glass transition being at T g = 196 K. The measurements 
were done at fixed frequency oo = 7.7 Hz and the results presented in the manner 
described in Section 11.5.2. For a perfect time-scale separation the curve should 
have a step-like form as sketched in the right panel of Fig. 15 and also included with 
line-points in Fig. 13.2. The experience shows that the FD ratio evolves very slowly 
from T* to T with a very long transient between one and the other. Measurements 
at lower frequencies should yield a more sharp separation between the two steps. 

13.3 Spin-glasses 

The parametric curve for the fully-connected SK model for spin-glasses is given by 
the curve with a varying slope in the right panel of Fig. 16. This result corresponds 
to having a succession of temporal scales each one with an effective temperature, 
T EFF (C). The question as to whether this behavior also applies to the finite di- 
mensional case remains open. The only results available for the moment and, most 
probably, for a long while are numerical and experimental. For the time-scales ex- 
plored, the parametric curves obtained have a very mild curvature. In order to 
decide beyond doubt if the asymptotic plot is curved it is necessary to perform a 
very careful analysis of the times and sizes explored (see [113]). 
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Figure 17: Left: the waiting-time evolution of the effective temperature of glyc- 
erol [60]. Right: the parametric x(C) plot for thiospinel, an insulator spin-glass [32]. 



Very recently Herisson and Ocio studied the evolution of the correlations in the 
magnetization fluctuations (noise) and the thermoremanent magnetization (inte- 
grated response) of thiospinel, an insulator spin-glass [32]. Their aim was to obtain 
the parametric curve x(C). In the right panel of Fig. 13.2 we show their results It 
is important to note that even the experimental data is very far away from the ex- 
pected nonequilibrium asymptote that is estimated to be given by the dotted-dashed 
curve in the figure, (for more details on this experiment see [32].) 

13.4 Rheology 

In Section 2 we have already explained that a non potential external force might stop 
aging. When the strength of this force is small, the separation of time-scales is still 
present but the dynamics becomes stationary. This fact makes the dynamics much 
simpler when observed in the time domain but it still captures some of the interesting 
features of non-equilibrium. For instance, the correlation function of a super-cooled 
liquid under homogeneous shear approaches a non-equilibrium stationary state and 
the parametric construction of Fig. 16 yields the same results where the waiting- 
time dependence is replaced by a shearing rate dependence. Thus, the red curve 
corresponds to a rather strong shearing rate, the green curve to a shearing rate of 
intermediate magnitude and the blue curves to the limit of vanishing shearing rate 
depending on the underlying system studied. These results were first obtained by 
solving the dynamics of a fully-connected model with non-symmetric interactions 
as the one introduced in Eqs. (2.7) and (4.9) [18, 34]. The numerical study of 
Lennard- Jones mixtures under uniform shear performed by Berthier and J-L Barrat 
completed the study of this framework [121] (see also [172] and [19]). 

In Section 14 we present the interpretation of the modification of fdt in terms of 
self-generated effective temperatures. Let us use this language here to explain these 
results and motivate further studies in other systems with different microscopic 
dynamics. Within the effective temperature interpretation, we see that T EFF (C) > T 
control the slow relation. In slightly more technical terms, the correlation scales 
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in which the time derivatives of the correlation are negligible with respect to the 
correlation itself evolve according to a temperature that is given by the modification 
of the fdt relation. This fact suggests that the effective temperatures should appear 
in systems in which the microscopic dynamics is not necessarily thermal but in which 
a separation of time-scales rapid-slow is self-generated as time passes. 

13.5 Vibrated models and granular matter 

In fact, a similar modification to FDT has also been observed for glassy models 
driven by a time-dependent oscillatory force that mimics the perturbations used 
to move granular matter [26]. In this case, since the perturbation introduces its 
own characteristic time t c oc it is more convenient to present the data using 
stroboscopic time, i.e. using a single point for each cycle. Modifications of fdt in 
models for granular matter were studied in [122, 123, 25]. 

13.6 Driven vortex systems 

The effective temperature has also been observed in the transverse motion of a drive 
vortex system [43] . Very interestingly, T EFF shares many quantitative properties with 
the "shaking temperature" of Koshelev and Vinokur [173]. 

13.7 Quantum fluctuations 

Even more spectacular are the results for glassy models in which quantum fluctua- 
tions are important and keep a separation of fast-slow time-scales [85, 106]. The fast 
scale is fully controlled by the quantum dynamics and the fdt takes the compli- 
cated quantum form described in Section 7. In the slow scale though the quantum 
fdt is no longer valid and it is replaced by a modified classical form in which the 
deviations from the classical fdt depend on the strength of quantum fluctuations. 
The dynamics in the slow scale superficially looks classical. This result was found 
in the solution to mean-field models (quantum extensions of the p spin and SK, 
fully connected SU(N)). It is important to notice that Montecarlo simulations of 
quantum problems in real-time are not possible. 

13.8 Systems of finite size: preasymptotic behavior 

The previous discussion shows that the correlation scales (time-scales) play a very 
important role in the global behavior of the systems. For relaxational systems we 
argued that the asymptotic parametric curve appears in the limit lim^^oo linijv^oo- 
The thermodynamic limit that is taken first ensures that the equilibration time, t EQ , 
diverges and cannot be reached by the waiting-time. For a systems of finite size, 
iV < +oo, the equilibration time is a function of N. In consequence, the limit curve 
x(C) has a lifetime that is bounded by t EQ . When the waiting-time becomes of the 
same order of magnitude as t EQ , the curve x{C) starts changing to approach the 
equilibrium asymptote, the straight line of slope —l/{ksT). The way in which the 
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Figure 18: The parametric pl°t f° r the p-spin model: relaxational dynamics 

(upper left panel) [12], with asymmetric interactions (upper right panel) [18], under 
the effect of an oscillatory field (lower left panel) [26] and with quantum fluctuations 
(lower right panel) [85]. The different curves on each panel correspond to different 
waiting-times. 

approach to equilibrium is achieved is not known in general. It is a very difficult 
problem even for fully-connected models and there is little hope to solve a problem in 
sufficient detail as to be able to determine all the crossovers. This might be possible 
for the 0(J\f) model of ferromagnetic growth or for the spherical SK disordered 
model. Crisanti and Ritort [160] analysed the crossover to equilibrium in the p spin 
model with numerical simulations. 

13.9 Critical dynamics 

Godreche and Luck studied the coarsening dynamics of ferromagnetic models quenched 
to the critical point T c . Spatial correlations develop in the system but only up to 
a length scale that grows as (r + t w ) 1 l Zc with z c the dynamic critical exponent. 
The equilibrium magnetization, m EQ , and, hence, g EA , vanish. Still, the dynamics 
is highly non-trivial. For finite though long t w a stationary regime for r <C t w and 
an interrupted aging regime for to <^ t w ~ r + t w can be identified even if they are 
not clearly separated by a plateau in the correlation at a finite q EA . In the former 
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regime, the correlation and response are stationary and satisfy fdt. In the latter 

C(t,t w ) » tzW v *F c (j-), x(t,t w )*t^F x (£) , (13.3) 

with f3 and v the usual static critical exponents and Fq and F x two scaling functions. 
As t w increases the stationary regime arrives up to lower values of C and when t w 
grows to infinity the full decay is stationary as in equilibrium. Since the interrupted 
aging part of C and R decay only algebraically with t w the x(C) plot for finite 
though long t w is very rich with a non-trivial functional form. Similar results were 
obtained for the critical dynamics of the XY model [124]. 



13.10 Connection with equilibrium 

The relation 

= }imP h (q), (13.4) 



_ T d\{C) 



dC 2 



C=q 



between the static and non-equilibrium dynamic properties of slowly decaying sys- 
tems, where x(C) is the non-equilibrium relation between integrated response and 
correlation function as defined in Eq. (11.27) and Ph(q) is the probability distribu- 
tion of overlaps 1 in the perturbed Gibbs state, became apparent from the analytic 
solution to some mean-field models. 

This relation holds in the exact solution to the SK model [104] and the problem 
of a finite dimensional manifold embedded in an infinite dimensional space in the 
presence of a random potential with long-range correlations [96, 36]. It is not verified 
in the exact solution to the p spin model and the manifold in a random potential 
with short range correlations. The reason for this discrepancy is that for the latter 
models the dynamics in the t w — > oo N — > oo limit approaches the threshold and 
not equilibrium. More precisely, all generalized susceptibilities, and in particular 
the energy density, approach a limit lim^^oojv^oo X GEN (^) = XtT Xeq N - 111 a11 
cases the dynamics occurs in a region of phase space that is different from the 
one sampled in equilibrium and, for p spin models and the like it has different 
statistical properties. For the former models, even if still the region of phase space 
explored by the dynamics is different from the one corresponding to the equilibrium 
states, its statistical properties can be thought to be somehow equivalent, since 
lim^oo^ocX 96 "^) = XT = X?r> and the elation (13.4) holds. 

More recently, Franz, Mezard, Parisi and Peliti proposed that the connection 
(13.4) goes beyond mean-field and applies to finite d systems in which all dynamic 
susceptibilities converge to their equilibrium values, linking in this way the (easy 
to measure) non-equilibrium dynamics properties of realistic models to the (hard to 
measure) equilibrium properties of the same models. Since a threshold level as the 
one found for the p spin model cannot subsist for ever in finite d, they argued that 
the validity of Eq. (13.4) should be rather generic. 

1 The overlaps are given by the correlation between two equilibrated configurations. 
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Several comments are in order. Corberi et al showed that there is a non-trivial 
nonequilibrium dynamic x(C) that does not satisfy Eq. (13.4) in one dimensional 
coarsening systems where the interface response does not vanish asymptotically (see 
Section 13.1). Even if the hypothesis of convergence of the generalized susceptibili- 
ties is not verified in this model, it provides a very simple example where the relation 
(13.4) does not hold. It might be possible to extend this result to domain growth 
in d > 1 with an interface geometry such that the domain wall response does not 
vanish asymptotically. This problem deserves further study. 

Based on numerical simulations, Marinari et al claimed [125] that the relation 
(13.4) is verified in the 3g?ea. As pointed out by Berthier, Holdsworth and Sellitto in 
the context of the XY model [124] and by A. Barrat and Berthier [113] in the context 
of the 2d and 3d EA models, one has to be extremely careful when extrapolating the 
numerical results obtained for finite waiting-time out of equilibrium and finite size in 
equilibrium. Indeed, these authors showed that one can tune the finite waiting-time 
and the finite size to have a relation like (13.4) well before the asymptotic limits are 
reached and even in the trivial phase of the XY and 2<iEA models. 

Finally, it is worth stressing that a non-trivial x(C) has been found in explicitly 
out of equilibrium situations for which equilibrium is trivial as, for instance, in 
rheological measurements of super-cooled liquids or in the long-time dynamics of 
super-cooled liquids before equilibration is reached. Indeed, non-trivial x(C) curves 
have been found in glassy model above the putative T s in Lennard- Jones systems 
and at finite T in models for which T s = like the kinetically constrained lattice 
models [53, 54]. 

In conclusion, a better determination of which are the conditions under which 
(13.4) holds is necessary. 

14 Effective temperatures 

Temperature has remained an ill-defined concept until the development of ther- 
modynamics and statistical mechanics. Evidently, the fact that a quantity, called 
temperature, must characterize the sensation of coldness or warmth has been known 
since the old times. However, temperature was usually confused with heat. 

The thermodynamics is an empirical theory based on four postulates that has 
been developed to determine some properties of the macroscopic objects without 
knowing the details of their constituents and interactions. After t EQ , an isolated and 
finite system reaches an equilibrium macroscopic state that can be characterized 
by a small number of parameters, the state variables. Temperature is one of these 
parameters. The first law states that energy is conserved in an isolated system after 
having established the equivalence between heat and work. The zeroth law states 
that if two systems are in thermal equilibrium with a third, then they are also in 
equilibrium between them. The temperature is determined by an auxiliary mea- 
surement. One sets a thermometer in contact with the system, waits until thermal 
equilibrium is established and then determines the temperature by calibrating the 
reading of the thermometer. If one repeats this procedure with a second system, 
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equilibrated with the first one, the first law ensures that the thermometer will itself 
be in equilibrium with the second system and, consequently, its reading will yield 
the same temperature. Hence, all systems in thermal equilibrium among them are 
at the same temperature. 

The statistical mechanics establishes a bridge between the mechanical description 
of the microscopic constituents of the system and its macroscopic behavior. It 
yields a precise sense to the concept of temperature. To illustrate this statement, 
let us take an isolated system in the microcanical ensemble with volume V and 
internal energy U. The entropy of the system is defined as S(U) = A;£lnf2([/) with 
Q(E)dE the number of accessible states with mean energy between E and E + dE. 
The micro canonical definition of temperature is given by l/(k B T) = 8S(E)/dE, 
evaluated at E = U. The development of statistical mechanics allows one to show 
that this definition is equivalent to the thermodynamic one. One can equally find it 
with the canonical and grandcanonical formalisms. 

The previous paragraphs describe the behavior of systems in thermal equilibrium. 
What can one say about the systems that evolve out of equibrium? Can one define 
a temperature for them? Or is it at least possible for a subclass of nonequilibrium 
systems? If this holds true, can one use this definition as a first step towards the 
development of a thermodynamics and a statistical mechanics for systems far from 
equilibrium? 

Hohenberg and Shraiman discussed the possibility of defining a temperature 
for certain systems out of equilibrium [126] using the modification of FDR. In 
Ref. [112] we critically studied the definition of such an effective temperature, T EFF , 
we insisted on the need to reach a regime with slow dynamics (related to small 
entropy production) to be able to define such a "state variable" and we demonstrated 
the importance of analyzing it in separated time-scales. In this Section we show in 
which sense the expected properties of a temperature are satisfied by T EFF and we 
display some numerical tests. 

14.1 Thermodynamical tests 
14.1.1 How to measure a temperature 

In normal conditions, the temperature of an object is measured by coupling it to 
a thermometer during a sufficiently long time interval such that all heat exchanges 
between thermometer and system take place and the whole system equilibrates. 
Let us call t — the instant when thermometer and system are set in contact. For 
simplicity, we choose to describe the thermometer with a single variable x. In order 
to have a statistical measure of the object's temperature [127, 72] we couple the 
thermometer to M independent copies of the system. Each system is characterized 



by a variable (f> a , a = 1, . . . , M. The energy of the total system is 
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Figure 19: Coupling between a thermometer and the observable A of the system. 

of the ath isolated system. Note the similarity between this coupled model and 
the treatment of system+environment done in Section 4 and the discussion on the 
harmonic oscillator coupled to a complex bath in Section 7.4.4. For a given value 
of M, the last term acts as an infinitesimal field kx/s/M that is coupled to the 
observable A[(p\ of each copy. The equation of motion of the thermometer reads 

m ^-Tw-VMt AlHth (141) 

Again for simplicity we choose an observable A with vanishing mean (A[0])fc =o = 
where the angular brackets represent the average over different histories of the system 
(see Section 5.1) or the average over different systems, i.e. (f) = l/MJ2 a =i fa- 
When the averaged observable does not vanish we use the difference between the 
observable and its average as the fundamental quantity. The index k = indicates 
that the average is taken in the absence of the thermometer. We denote ( the 
averaged in the presence of the thermometer. Equation (14.1) can be rewritten as 

mx(t) = -^H- + k 2 f ds R(t, s)x(s) + pit) (14.2) 
ax(t) Jo 

with R(t, s) the linear response of the observable A((f>) to the change in energy 
E T0T —> E TOT — k/y/M x A{4>) performed at time s. The force p(t) is a sum of M 
independent random variables and due to the central limit theorem, it becomes a 
Gaussian variable with vanishing average and variance 

(p(t)p(s)) k = k 2 C(t,s) = k 2 (A{$](t)A$](s)) k=0 (14.3) 

for large M at first order in k. Thus, the evolution of the thermometer is determined 
by a Langevin-like equation [cfr. Eq. (4.7)] with a correlated noise p(t) and a 
retarded friction generated by the coupling to the systems. For a generic system 
out of equilibrium there is no relation between R and C. For the problems we are 
interested in there is one. Next we explore the consequences of the modification of 
fdt for the reading of the thermometer. 
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If the systems are equilibrated with their environments fdt holds and it ensures 
that R is related to C by R(t,s) =l/(k B T)d a C(t,s) 6(t - s), with T the temper- 
ature of the thermal bath. The thermometer is then coupled to an equilibrated 
colored bath and it will eventually reach equilibrium with it. The reading of the 
thermometer is defined from the value of its asymptotic internal energy and it has 
to be callibrated from the characteristics of the thermometer that, of course, must 
be known before starting the measurement. If one takes a simple harmonic oscilla- 
tor as a thermometer, one proves that the internal energy approaches k B T. This is 
the result expected from equipartition since the oscillator has only two degrees of 
freedom (position and momentum). 

Imagine now that the systems are glassy of the type discussed in Section 12. If 
one studies a system with two correlation scales such that 

,_(RsT(t-s) ift-s«s J C ST (t-s) ift-s<s 

m S) ~ \ \ Rag (f ) if f = 0(1) ° ^ S} ~ \ C AG (f ) if f = 0(1) 

R ST (t - s) = j^d s C ST (t - s) , Rag = -j^^d a C AG Q 

with T the temperature of the thermal bath and T* a different value read from the 
modified fdt relation. The reading of the thermometer, or its asymptotic internal 
energy density, is found to be [112] 

uj C(uJo,t w ) 

where Uq is the characteristic frequency of the thermometer, C(uq, t w ) is the Fourier 
transform of the correlation function with respect to the time-difference and x"(^o> t w ) 
is the out of phase susceptibility defined in Eq. (5.8). 

If the characteristic frequency ojq is very high, the thermometer evaluates the 
evolution during the first step of the relaxation t — s <C s, one finds E TiiERM = k B T 
and one identifies T with the temperature of the system. Instead, if the characteristic 
frequency is very low, the thermometer examines the behavior of the system in the 
long time scales, s/t = 0(1) in the example, one finds .EWerm = k B T* and one 
identifies T* as the temperature of the system. 

One can easily generalize this discussion to a problem with many correlation 
scales, each with a different value of the effective temperature. In order to measure 
them it is sufficient to tune the characteristic frequency of the oscillator to the 
desired scale. 

A concrete realization of this measurement corresponds to a generalization of 
the Brownian motion experience of Perrin in which one follows the evolution of a 
tracer immersed in the fluid. If the latter is equilibrated at temperature T, after 
a short equilibration period, each component of the averaged kinetic energy of the 
tracer approaches ksT/2. Instead, if the fluid evolves out of equilibrium, one can 
choose the mass of the particle (that plays the role of the characteristic frequency 
in the previous discussion) in order to examine the rapid dynamics, or the slow 
dynamics. The tracer acquires an averaged kinetic energy E Km = k B T*/2 with 
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Figure 20: A Lennard- Jones liquid with two types of particles, A and B, in its 
liquid phase under homogeneous shear. Left: the asymptotic value of the trans- 
verse component of the averaged kinetic energy of the tracer particle normalized by 
hsi T\ sce ff = m TR (vf) /ks, against its mass. Right: Parametric plot between the 
linear response integrated over a time-interval of length t — t w , x{^]t — t w ), and 
the incoherent scattering function C(k;t — t w ). The four first curves correspond to 
k = 1.87,3.74,7.47,11.22. The self-displacement is also shown. The equilibrium 
straight line of slope —l/^ksT) is represented by a black line while the black dotted 
parallel straight lines have slopes —l/^ksT*). From Ref. [121]. 

T* the value of the effective temperature in the time scale explored. Berthier and 
J-L Barrat [121] performed this measurement in a numerical experiment using a 
dense liquid modeled as in Eq. (2.4) under homogeneous shearing in contact with a 
thermal bath at temperature T as a fluid. They chose a Lennard- Jones particle as a 
tracer with mass m TR . The left panel shows the asymptotic value of the transverse 
component of the averaged kinetic energy (transverse to the shearing rate direction) 
as a function of the mass of the tracer. One clearly sees how the effective temperature 
T* = m TK (v 2 z ) /ks interpolates between the value T at small masses and the value 
T* > T for large masses. The trend can be easily understood. A very light tracer 
easily reacts to the quick bombardment of the particles in the fluid and it feels the 
temperature of the bath via the rapid scale of relaxation. A heavy tracer instead 
can only move via large rearrangements of the fluid and these correspond to the 
slow part of the relaxation. The transition between the two values is very smooth 
and it occurs over several orders of magnitude in the mass. The consistency of the 
explanation, i.e. the relation between T* and the fdt relation, will become explicit 
in Section 14.1.2. 

A complementary discussion on thermometric measurement of T EFF and, in par- 
ticular, of the effect of not having well-separated time-scales, appeared in [41, 128]. 

14.1.2 Zeroth law 

A temperature, even if it is defined out of equilibrium, should control the direction 
of heat flows and the partial equilibration between observables in interaction. (Two 
observables interact if and only if the crossed linear response R^B{t,t'), as defined 
in Eq. (5.5), does not vanish.) 
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With a pair of observables A and B one constructs two self and two cross cor- 
relations and responses. In each correlation scale the fdt relation is modified by 
a constant factor with which one constructs the effective temperature. If the no- 
tion of an effective temperature is correct, two interacting observables that evolve 
in the same time-scale should acquire the same value of T EFF . The equilibration 
between different observables is well defined only in the limit of small heat, or en- 
ergy, exchanges. This limit is achieved in a free relaxing system when the waiting 
time becomes very long or in a driven system rendered stationary when the non- 
conservative force vanishes. It is only possible for observables evolving in the same 
time-scale (note that even a single observable can have several values of the effective 
temperature when examined on different time-scales). We call partial equilibrations 
those arriving in the same time-scale. In contrast, if the two observables A and B 
do not interact they should evolve in different time-scales. 

The property of partial equilibration has been proven analytically for the fully 
connected models solved in Section 12 [112] and, later, for all perturbative approxi- 
mation of more realistic models under the assumption of there being a slow dynamics 
with a sharp separation of time-scales [72, 130]. It can be seen numerically as fol- 
lows. Take, e.g., two p spin models with different exchange strengths, J\ and J2 
in contact with the same thermal bath at temperature T and couple them linearly 
with a term a Y^L\ s i°~i where Sj and <7j are the dynamic variables of each system 
and a is the coupling constant. (Other couplings are, of course, possible.) When 
a = the two systems evolve independently and their T EFF 's in the aging scale take 
different values. If we now let the coupled system (a > 0) evolve it will reach an 
asymptotic limit (roughly when the energy of the full system decays very slowly). In 
this limit we trace the fdt parametric plots for the two self and cross C and i?'s. We 
observe that if a < a c the cross responses vanish and the effective temperatures still 
take different values in the aging scales that are now forced to evolve with different 
scalings. Instead, if a > a c , the cross responses do not vanish, the two systems 
lock and T EFF in the aging scale acquires the same value for both self and cross FD 
relations. Note that for the manifold, all modes have the same value of the effective 
temperature in the same correlation scale. This is achieved internally and it means 
that all modes are in interaction. 

Partial equilibrations have been tested numerically by Berthier and J-L Bar- 
rat [121] in the dense homogeneously sheared liquid discussed in Section 14.1.1 
(partial equilibrations simply relaxation Lennard- Jones mixture were studied by 
Kob and J-L Barrat in [58]). The relevant correlators for this system are the wave 
vector dependent incoherent scattering functions and their associated responses. 
Berthier and Barrat measured these two-time functions for the same and different 
species and several values of the wave vector. Figure 20 shows the parametric fdt 
plots. All the curves have a broken line form with a first part with slope — 1/(/cbT) 
and a second part with a common slope — l/iksT*). The value T* is identical to 
the result found monitoring the kinetic energy of the tracer (see Section 14.1.1) 
demonstrating that the scenario is consistent. Note that in this case we cannot tune 
the coupling between different wave vectors as we did when we externally coupled 
the two p spin model. The fact that T EFF in the slow scale is the same for all wave 
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vectors studied shows that they interact. This is also seen from the fact that the 
cross responses do not vanish. Coupled oscillator models with parallel or sequential 
Montecarlo dynamics do and do not partially equilibrate, respectively. [129]. In the 
latter case the thermal conductivity is very small and one is in situation in which, 
effectively, a < a c . 

Intriguingly, the fact that each time-scale has its own effective temperature has 
been shown to fail in two models. These are the trap model [48] and the Id Ising 
chain at T = [48, 119, 120] when special perturbations are applied. In both cases 
one can construct observables that evolve in the same time-scale but have different 
values of the effective temperatures. In the first case, the failure might be adscribed 
to the fact that the model does not have an equilibrium state. This is not the case 
in the second model though. The origin of the failure might then be related to 
having used special observables, see the discussion in [48]. Still another pathology 
was already signaled for this problem: the global correlation and response decay in 
a single time-scale but the asymptotic x(C) is a curve contradicting the notion of 
a correlation-scale dependent effective temperature. It is quite plausible that this 
problem is also related to the failure of the relation between dynamics and statics 
discussed in Section 13.10. A good understanding of the conditions under which 
this property holds is still lacking. Experiments in laponite show some mismatch 
between the value of T EFF found with mechanical and electrical measurements. The 
reason for this is unclear [61]. 

One can also verify that the heat exchanges go from the higher values of T EFF to 
lower ones. However, it is still not clear why one can have a partial equilibration to 
a higher value of T EFF than those of the two independent observables, as it has been 
obtained analytically for some solvable fully-connected models. 

14.1.3 Auxiliary thermal baths 

A supplementary verification of the thermodynamic character of the effective tem- 
perature comes from the study of the action of complex thermal baths on the dy- 
namics of simple systems, as discussed in Section 14.1.3, or glassy systems. 

We found that an arbitrarily weak auxiliary bath with 7(0) small has an impor- 
tant effect provided it is sufficiently slow and its temperature is within the range of 
values of the effective temperatures of the slow dynamics. The (slow) time depen- 
dence of all C and i?'s are affected by a time rescaling t — > K(t). This is such that 
the time-scale which has an effective temperature equal to the temperature of the 
auxiliary bath, say T±, is locked to the time-scale of the bath. In particular, if we 
couple an aging system with a bi-valued T EFF = (T, T*) to a composite stationary 
bath with two time scales, T\ — > and r 2 > and two temperatures T and T 2 , respec- 
tively, we find that the system becomes stationary if T 2 > T*, and is hardly affected 
if T 2 < T*. More generally, an aging system with multiple effective temperatures, 
T EFF (C), becomes partially stationary for all the time-scales with T 2 > T EFF (C), but 
still ages for time-scales with T 2 < T EFF (C). We found this behavior in Montecarlo 
simulations of the 3g?ea model [130]. 
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14.2 Temperature fixing by SUSY breaking 

For any model one can derive a set of integro-differential equations that couple all 
two-point functions. These admit a representation in terms of the super-correlator 
Q(a,b). In the asymptotic limit in which we neglect the time- derivatives, these 
equations are invariant under any change of supercoordinates, a, that have unit 
superjacobian [162]. Fixing the time-reparametrisation (the function h(t) in each 
correlation scale) and the value of the effective temperature corresponds to breaking 
this large symmetry group to a subgroup [130]. 

14.3 Fictive temperatures 

"Fictive temperatures" are phenomenological concepts that have been used to de- 
scribe experimental data [131] (see also [132]). The basic idea has been to claim 
that, when crossing T g , the system remembers its equilibrium configuration before 
the quench and it remains effectively at a higher temperature Tf. Several refined 
prescriptions to extract time and preparation dependences of Tf have been proposed. 
The relation between T EFF and Tf has been discussed in [112]. Here we simply stress 
that even if the same basic idea can be used to interpret T EFF , the latter has the 
properties of a thermodynamic temperature while this is not obvious for Tf. 

14.4 Nonequilibrium thermodynamics 

Once equipped with a bonafide effective temperature the natural next step is to try 
to construct a thermodynamics for such systems out of equilibrium. This has been 
proposed by Nieuwenhuizen [133] based on two previous results: (1) similar con- 
structions done using the fictive temperatures by Tool, Moynihan and others [131]. 
(2) the relation between the dynamics and the tap approach that we shall discuss 
in Section 15. The idea is to define generalized thermodynamic potentials in which 
T EFF intervenes as a supplementary parameter (one can also include other state vari- 
ables as an effective pressure, etc.). For the fully connected models these potentials 
have a precise meaning based on the TAP analysis (Section 15). Their validity for 
more realistic models is still an open problem. 

14.5 Statistical mechanics 

Edwards measure 

In the 80s Edwards proposed that the stationary properties of dense granu- 
lar matter under a weak forcing can be determined with a flat distribution of the 
blocked configurations, i.e. those in which no grain is able to move) at the cho- 
sen density [134]. Note that this is possible in granular matter since the external 
temperature is irrelevant. Following this "microcanonical" approach the logarithm 
of the number of blocked configurations at constant density defines an entropy 
from which one obtains a compactivity by simple derivation with respect to the 
density. Extending this prescription one can define an Edwards' temperature for 
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soft systems by considering blocked configurations at fixed energy and computing 
l/(k B T EDW )=dS EDW (E)/dE. 

Edwards' temperature can be calculated explicitly for the fully connected mod- 
els at zero external temperature (again using techniques discussed in Section 15). 
Surprisingly, one finds that its actual value coincides with the value taken by T EFF 
defined from the modification of fdt in a purely dynamic calculation. This result 
has boosted the study of solvable models in low dimensionalities analytically and 
more realistic systems numerically to check if the coincidence goes beyond the fully- 
connected case. Until now, several models where Edwards' distribution yield very 
good results have been exhibited [122, 135] while some others where it fails have also 
been shown (e.g. the random field Ising model [122]). In the latter cases one finds 
a well-defined T EFF while Edwards' measure fails to give the correct results. The 
result of including additional constraints on the configurations counted have also 
been analysed and naturally improve the results derived from Edwards' measure. 
This area of research is very active and more work is necessary to determine the 
limits of validity of Edwards' proposal. 

The definition of Edwards' measure is unambiguous since it is a zero temperature 
entity based on the study of minima of the potential energy. An extension to finite 
T necessitates the analysis of a free-energy landscape. This can be done analytically 
for fully-connected models as explained in Section 15. In finite d cases for which one 
is forced to use numerical techniques it is not, however, obvious how to define, let 
alone compute, the entropy E(/5, /). 

Inherent structures 

The inherent structure approach of Stillinger and Weber [136] has been recently 
revisited and extended to study dynamic properties of glass formers and glasses [137]. 
The original approach, even if static, is close to the ideas of Edwards. At the static 
level it consists in dividing the partition function in inherent structures, or pockets of 
configurations around minima of the potential energy, and transforming the sum into 
sums over minima and the configurations associated to them. In order to connect 
with the dynamics, one computes the entropy of the inherent structures and then 
derives an inherent structure temperature with a similar prescription to the one of 
Edwards. The sampling of the inherent structures numerically is a non-trivial issue. 

A critical analysis of the applicability of this approach at finite temperatures has 
been presented by Biroli and Monasson [142] who stressed the need of analyzing the 
free-energy, instead of the potential energy, at finite T. They also compared with 
the tap analysis discussed in Section 15. Having said this, the use of the inherent 
structure approach has been rather successful when confronted to T EFF [137]. 

15 Metastable states 

The aim of the tap approach is to define and study a free-energy density as a 
function of the relevant order parameters [56]. Its stationary points are the (stable 
and unstable) metastable states. For a fully connected Ising magnet the tap free- 
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energy density simply depends on the averaged global magnetization and, below T c , 
has the form drawn on the right panel of Fig. 1. The vanishing global magnetization 
is not a good order parameter for disordered spin systems and one is forced to 
introduce all local ones. The approach can be extended to describe classical and 
quantum systems in and out of equilibrium [143, 144]. Under different names similar 
approaches appear in other branches of condensed matter physics. The density 
functional theory of the inhomogeneous electron gas in solids or the dynamic mean- 
field theory of strongly correlated electrons are very similar in spirit to the TAP 
approach [91]. 

The clearest way of deriving the TAP free-energy density for disordered models is 
based on two ingredients: one identifies an adequate perturbative expansion, and one 
Legendre transforms the standard free-energy density with respect to a well-chosen 
set of parameters. When these two choices are correctly done, only a finite number 
of terms in the expansion do not vanish for typical configurations of disorder for 
infinite dimensional models. In finite d one can attempt a large d expansion [146]. 

For spin-glasses at low-T the tap free-energy density has an infinite number of 
stationary points. The tap approach gives us access to the complete organization 
of metastable states of any type of stability (minima, saddles of all types, maxima). 
In particular, this has been analysed in great detail for the p spin model and the 
like since we expect it to mimic what occurs in real glassy systems though in an 
exaggerated manner. 

In the following we first derive the TAP free-energy density for a generic spin 
model with Ising or spherical variables. Next we summarize the consequences of this 
approach for the p spin spherical model. We also briefly explain how the number of 
metastable states is computed and how this depends on the parameters in the model. 
We explain how the approach is generalized to deal with dynamic properties. This 
full set of results gives us a complementary view of the non-equilibrium dynamics 
and serves as the basis for an image of the dynamics of finite d glassy models. 



15.1 Equilibrium 

Before describing the tap approach let us summarize the equilibrium behavior of 
the mean-field models as derived from the analysis of its disordered averaged free- 
energy density —/3[f]j = [\nZ]j/N with the replica trick. Again the three classes, 
ferromagnetic- like (p = 2), glassy-like (p > 3) [167] and spins-glass- like (sk) [9] 
models have different characteristics. 

For the spherical p spin model with p > 3 [167] the standard Parisi Ansatz [69] 
yields a static transition at T s from a paramagnetic phase where a replica symmetric 
Ansatz solves the problem to a glassy phase where a one step replica symmetry 
breaking Ansatz is needed. At low T's, the breaking point parameter, x, and the 
Edwards-Anderson order parameter, q EA = N -1 X^[( s i) 2 ]> i n the Parisi matrix are 
fixed by requiring that the free-energy density be a maximum. This yields a static 
transition temperature, T s , given by the set of equations T s = y\Jp/ (2y)(l — y) v l 2 ~ x 
and 2/p = -2y(l - y + lny)/(l - y) 2 . One can check that T s < T d . The static 
transition is discontinuous in the sense that q EA jumps at T s but it is of second 
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order thermodynamically since all susceptibilities are continuous across T s . The 



[-£(T = 0) - \J—£ 2 (T = 0) - £^]/{p - 1). One checks that £ EQ <E< X> = & 



A modified prescription to determine the breaking point, x, in the one step 
Ansatz yields different results. If instead of extremizing with respect to x one re- 
quires that the solution be marginally stable by setting the replicon eigenvalue of the 
matrix of quadratic fluctuations [175] to zero, leads to a different solution with a dy- 
namic meaning. (All other eigenvalues are positive.) Namely, one finds a transition 
from the paramagnetic to the glassy phase at a higher temperature that coincides 
with the dynamic critical temperature found with a purely dynamic calculation, Tj. 
Moreover, q EA coincides with the dynamic one and the breaking point x yields the 
ratio T/T EFF . Consequently, all one-time quantities as the asymptotic energy den- 
sity and generalized susceptibilities coincide with the ones found dynamically (e.g. 
£ = £ TH ). The fact that with the condition of marginal stability we access the region 
of phase space reached dynamically is due to thte fact that with both we search for 
the path of flat direction formed by the threshold level, as explained below. 

When p = 2 instead [108], the replica solution below T s is replica symmetric 
with a non-vanishing q EA and marginally stable. The static transition is continuous, 
dynamic and static transition temperatures coincide, T s = T d , and x = T/T EFF = 
[109]. The gap between the threshold and the equilibrium level collapses and 
the static energy density is the value reached dynamically, £ m = £oo. Still the 
nonequilibrium dynamics does not stop in finite times with respect to N. 

For SK the equilibrium calculation needs a full replica symmetry breaking so- 
lution [9]. This can be interpreted as being equivalent to having a sequence of 
correlation scales in the nonequilibrium dynamics. The static transition is contin- 
uous, the static and dynamics g EA are identical, the relation in (13.4) holds and all 
one-time quantities coincide with the equilibrium values. The static solution is also 
marginally stable. 

From these three paragraphs one observes that the structure of the static and 
dynamic solution of purely potential mean-field problems is indeed very similar. One 
can propose a "dictionary" 

RS 2 corr. scales, the aging one with T EFF = T* — > oo 
1 step RSB 2 corr. scales, the aging one with T EFF = T* < +oo 
full RSB oo corr. scales, the aging ones with T EFF (C) < +oo 

while remembering that the replica solution that describes the statistical properties 
of the region of phase space reached dynamically has to be determined using the 
condition of marginally stability - and not equilibrium. This connection between 
replicas and dynamics has been extensively exploited to use the replica trick as a 
substitute for dynamics. In fact, partial information about dynamics as the dynamic 
critical temperature, the value of T EFF , etc. is thus obtained. One has to keep in 
mind though that many aspects of the dynamics go beyond static calculations. 
Features like the existence of an effective temperature have been shown in models 



equilibrium energy density at T = is given by the implicit equation 
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with trivial statics [53, 54] or above the dynamic transition when non-potential or 
time-dependent forces are included [19, 26]. 



15.2 Static TAP approach 

In the introduction to this Section we announced that two choices facilitate the 
derivation of the tap free-energy density. In order to use a good perturbative 
expansion we weight a part of the original Hamiltonian with a parameter a. For the 
p spin model we simply propose 

H(a,s) = a J2 J ii,..,i P s ii ■ ■ ■ s i P ■ ( 15 - 5 ) 

ii<...<i p 

In other models we weight the higher order interactions with a without modifying 
the quadratic terms. The idea is to expand in powers of a and set a = 1 at the end 
of the calculations to recover the original model [145, 146]. 

The second important step in the derivation is the choice of the order parameters 
to use in the Legendre transform of the free-energy density. For spin models these are 
the averaged local magnetizations rrii and a global spin constraint /. The Legendre 
transform reads 

-PT([3, a; rm, /; h h A) = In TV s . e -^ H(a ' s) -^i £f =1 (*H) . (15.6) 

The trace represents a sum over all configurations of the spins, e.g. Tr^ = YiiLi Z) Si =±i 
for Ising and Tr^ = Jf^ n£Li dsi for spherical variables. Requiring stationarity with 
respect to the Langrange multipliers hi and A one obtains 

1 N 

m i ={s i ) and / = — 5^<sf> , (15.7) 
iV i=i 

for all values of a. The angular brackets indicate the statistical average over the 
spins using the full Botzmann weight in (15.6). Since the RHSs depend on hi and 
A these equations can be inverted to yield hi(/3, a; rrii, I) and A(/3, a; rrii, I), that one 
substitutes in (15.6) to write T as a function of (f3,a;rrii,l). Henceforth we drop 
the parameter dependence and simply note T. The introduction of the parameter a 
allows us to express — f3T as a power series in a: 



n=0 9aT 



a 

^ . (15.8) 

a=0 



For the p spin model and the like this is equivalent to a high T expansion. In other 
cases it is an expansion around an "equivalent" free theory. Interestingly enough 
only a finite number of terms contribute to the series for fully connected models. For 
finite dimensional cases a truncated series yields an approximation around mean- 
field. 
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The zero-th order term depends on the nature of the spins considered: 
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These are the entropies of iV independent Ising or spherical spins constrained to 
have local magnetizations m^. The first order term is proportional to 
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In the first equality, the last two terms on the RHS vanish due to Eqs. (15.7). The 
average in the first term factorizes since it has to be taken with the free-action 
(a — 0). The quadratic term in the expansion is proportional to 

d 2 (-f3T)\ 



da 2 



(15.10) 
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This term has been computed using the following identities. First, the variation of 
— f3T in Eq. (15.6) with respect to m 8 and / yields hi = 9<y Q^P and A = j| 8( - r ^ . 
Taking the variation with respect to a and evaluating at a = one has 
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a=0 



Now, the contributions O(N) are proportional to J? ip and these can be estimated 
by replacing its value by p\/(2N p ~ 1 ) since J^,...,^ ~ Jp\/(2N P ~ 1 ). As done for the 



first order term we factorize the thermal averages evaluated at a — and 
d(-(3T lslNG ) 
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(15.12) 
(15.13) 

(15.14) 



where we introduced the overlap or (static) Edwards-Anderson parameter, 

1 N 

<?ea = ^2^ m i ■ 

iv 1=1 

Higher order terms in the series expansion are sub-leading in N and do not 
contribute in the thermodynamic limit. Thus, for these mean-field models the TAP 
free-energy density is made of three terms: the zero-th order has an entropic origin, 
the first order is the interaction term in the mean-field approximation which is exact 
for fully connected models, and the second order is the reaction or Onsager term. 
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15.3 The TAP equations 

The variation of the tap free-energy density, —f3T, with respect to rrii (and / for the 
spherical model) yields the tap equations. For the spherical model one finds [147] 
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The study of these equations is simplified by defining the angular variables o~i = 
rrii I -\/<1ea that verify the spherical constraint = 1. Multiplying Eqs. (15.15) 

by Oi and summing over % we rewrite them in terms of the zero-temperature energy 
density £ = -± En<...<i P Jh,.,i p Vii ■ ■ • <V 



Eoi = - 

The overlap q EA is related to £ by 
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Equation (15.17) does not depend on T while (15.18) does. The multiplicity of 
solutions at a given £ is entirely determined by Eq. (15.17), see Section 15.5. The 
existence or not of these solutions has to be tested with Eq. (15.18). The remaining 
Eq. (15.16) fixes A. 

Conveniently rewritten Eq. (15.18) is quadratic and yields 
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This equation admits a real solution only if £ < £ TH , the threshold energy density 
at T = 0. The minus (plus) sign correspond to a minimum (maximum) of the free- 
energy. The physical q EA is then associate to the minus sign. With this choice, q EA 
takes its maximum value on the theshold and then monotonically decreases until 
reaching its minimum value on the equilibrium level, g(£ T H) > <?ea(£) > <?ea(£eq)- 

For fixed (5 and £ the lhs in Eq. (15.19) has a bell shape form. When T — > 0, 
q EA — > 1 and (3(1 — q EA ) is finite. The maximum is located at q* A — (p — 2)/p and 
it has a height 2/p ((p — 2) / p)^ p ~ 2 ^ 2 . Each solution at T = that corresponds to a 
given £ can be followed to finite T until it disappears at T*(£) when the lhs reaches 
the maximum. One can check that the tap solutions do not merge nor bifurcate as 
a function of T. Then at any temperature T we label the TAP solutions with their 
associated zero temperature energy density £. 

Plugging £ TH in Eq. (15.18) we find that the overlap q EA is given by the equation 
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The threshold energy density £ TH and the overlap g TH coincide with the asymptotic 
value of the dynamic energy density and the Edwards- Anderson parameter at T = 0, 
respectively. Thus, the nonequilibrium dynamics approaches asymptotically the 
threshold level. 

15.4 Stability of, and barriers between, the TAP solutions 

The spectrum of the free-energy Hessian around a stationary point of the tap free- 
energy is a shifted semi-circle. The lowest eigenvalue A MIN is greater than zero 
for sub-threshold free-energy densities (or zero-temperature energy density). This 
means that for £ < £ TH typical stationary states are minima. Instead, near the 
threshold A MIN drops to zero as [12] 

\u*U,T)~ — Ura-f) (15-21) 

and the stationary states on the threshold are typically marginal in the sense that 
they have many flat directions. 

Even if the connection between dynamics and the static TAP free-energy land- 
scape is not obvious a priori, it has been proposed and used in several works [11, 12]. 
The formalism in Section 15.8 and [148] settles it on a firm ground. If one imagines 
that the dynamics can be viewed as the displacement of a representative point in 
the free-energy landscape, not only the organization minima, saddles and maxima 
has to be known but also how do the barriers between these stationary points scale 
with N. Few results about barriers exist and, in short, they are the following. The 
barriers between threshold states vanish when N — > oo [3, 149] and there is no 
sharp separation between them. This has been proven by analyzing the constrained 
complexity, related to the number of threshold states that have an overlap q with 
a chosen one (q = N' 1 X^Li °~i r i where a and f are the two configurations). This 
complexity decreases with increasing values of q and it vanishes as a power law at 
Q — <7™- This means that one can find threshold states that are as similar as required 
to the chosen one. The threshold level is then a series of flat connected channels. 
The non-equilibrium dynamics starting from random (typical) initial conditions ap- 
proaches this level asymptotically and it never stops since the system drifts in a 
slower and slower manner as time evolves following these flat directions [12]. On the 
other hand, the barriers between equilibrium and metastable states have been esti- 
mated to be O(N) [147, 149]. One can guess that the barriers between sub-threshold 
TAP states also scale with N. For finite N the dynamics should penetrate below the 
threshold and proceed by thermal activation. An Arrhenius-like time will then be 
needed to descend from one level to the next. Naturally one should see another kind 
of separation of time-scales develop. Simulations of the p spin model for finite N 
confirm the existence of metastable states below the threshold. This is most clearly 
seen following the evolution of the energy density of the model weakly perturbed 
with a non-potential force. One sees periods of trapping in which the energy-density 
is fixed to a given value and periods in which the system escapes the confining state 
and surfs above the threshold until being trapped in a new state [18, 26, 19] (see 
also [160] a numerical study of the finite N p-spin model). 
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15.5 Index dependent complexity 

At low T's the number of stationary points is exponential in N. This suggests to 
define the complexity £j(£): 

= lim TV -1 \nHj{£) , (15.22) 

where Nj{£) is the number of solutions with energy density £. Actually, one can 
refine the study by grouping the stationary points of the tap free-energy density into 
classes according to the number of unstable directions. Thus, minima are saddles 
of index 0, saddles with a single unstable direction have index 1 and so on and so 
forth. The complexity of each kind of saddle is £j fc (£) = hin^^oo iV -1 In J\fj k (£), 
where k denotes the index of the considered saddles. For the spherical p spin model, 
their average over disorder, £& = [Sj fc ], are ordered in such a way that [150] 

E (£) > > E 2 (£) > ... for all £ < £ TB 

£ (£) = £i(£) = £ 2 (£) = ... if £ = £™ 

Thus, when £ < £ TH minima are exponentially dominant in number with respect 
to all other saddle points. Moreover, one proves that the complexities vanish at a 
/c-dependent value of £. The complexity of minima is the last one to disappear at 

£eq- 



15.6 Weighted sums over TAP solutions 

The thermodynamics at different T is determined by the partition function, Zj. De 
Dominicis and Young [151] showed that the equilibrium results obtained with the 
replica trick or the cavity method are recovered from the TAP approach when one 
writes Zj as a weighted sum over the TAP stationary states. 

Indeed, if one divides phase space into pockets of configurations that surround 
the stationary points of the TAP free-energy one can carry out the statistical sum 
on each sector of phase space: 

Zj = ^eM-PHj(Z)) = ^^exp(-/3// J (0) (15.23) 

s a 

where the index a labels the tap solutions and J2s°> represents a restricted sum over 
the configurations that belong to the pocket associated to the solution a. In order 
to make this separation precise one needs to assume that the barriers separating the 
pockets diverge in such a way to avoid ambiguities when associating a configuration 
to a tap solution. The restricted sum is related to the free-energy of the TAP 
solution exp(— f3Fj{m a )) = J2s a exp(— PHji^s ")) and the partition function becomes 
Zj = J2 a exp[— f3Fj{m a )\. Thus, any statistical average can be computed using the 
weight exp[— f3Fj(m a )]/ Zj. The sum over solutions can be replaced by an integral 
over free-energies if one introduces their degeneracy Afj(f3, f) and their associated 
complexity, Sj(/3, /) = iV" 1 In Nj{(3, /), with / = F/N, 

Zj = Jdf exp [-N(0f - Ej(/3, /))] . (15.24) 
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The complexity is a self-averaging quantity, we then write £j(/3, /) = /). When 
N — > oo the integral is dominated by the solutions that minimize the generalized 
free-energy, (3f — /). This is achieved either by f — f Mm with S(/3, / MIN ) = or 
by states that do not have the minimum free-energy if their complexity is finite, in 
which case [138] 



Minima of the generalized free-energy density with higher (/ > /*) or lower (/ < /*) 
free-energy density are metastable. 

From the analysis of the partition function one distinguishes three temperature 
regimes [11, 138]: 



The paramagnetic or liquid solutions m 8 = 0, Vi, dominate the partition sum, 
Z ~ exp(— (3f PM ). States with m; ^ exist in this range of temperatures but they 
do not dominate the sum. 

Between the static and dynamic transitions T s < T < T d . 

The paramagnetic state is fractured into an exponential in N number of non- 
trivial tap solutions with 7^ 0. Their free-energy density and the partition sum 
are given by Eq. (15.25). Each of these states has a rather high free-energy that 
is counterbalanced by the entropic contribution. Besides the states that dominate 
the partition sum, a very large number of other metastable states, with higher 
and lower free-energy density, also exist but are thermodynamically irrelevant. It 
turns out that /* coincides with the extrapolation of f PM from T > T d to this 
temperature region even if the paramagnetic solution does not exist. Note that in 
this temperature regime the standard replica calculation fails since it tells us that 
the equilibrium state is the simple paramagnet. Refinements on this method are 
able to extract more precise information about the non-trivial states contributing 
to equilibrium [149]. 

Below the static transition T <T S . 

An infinite though not exponential in N number of states with the minimum 
free-energy density dominate the sum. The complexity £(/?, /) vanishes and this is 
associated to an entropy crisis. This is similar to the argument used by Kauzmann 
to justify the existence of a dynamic crossover at T g > T s since, otherwise, the 
projection of the difference between the liquid and the crystal entropy would vanish 
at Tk- In this sense, this model realizes the Kauzmann paradox at T s . 

15.7 Accessing metastable states with replicas 

The replica trick can be improved to access the non-trivial metastable states existent 
between T s and T d [169, 138, 139] using a "pinning-field" or a "cloning method". Let 
us sketch how the latter works. Consider x copies or clones of the systems coupled 



df 



=► Zj ~ expHV(/?r - E(£ /*))]. 



(15.25) 



Above the dynamic transition T > Td = 
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by an attractive, infinitesimal (but extensive) interaction. The free energy for the 
system of x clones reads: 

f Jx = hm ^ \nZ Jx = lim ^ In / dfexp[-N((3xf - £(/3, /))] (15.26) 

using the formalism described in the previous Subsection. On the other hand, the 
free-energy density of the x clones can also be computed with the replica approach: 

N^oo fji\ N^oo,n^0 pl\n 

where we used the fact that the free-energy density is self-averaging. Since the 
attractive coupling between the x clones is infinitesimal, the computation of the RHS 
of Eq. (15.27) reduces to the calculation of \im n /^o(x/n') \n[Zj n ], where the replica 
symmetry between the n groups of x-replicas (n' = nx) is explicitly broken. When 
the system is in the replica symmetric phase (T s < T), the problem becomes one 
where one has to study one-step replica symmetry breaking solutions non-optimized 
with respect to x: 

- jirn^ In J df exp[-N(l3xf - E(/3, /))] = x Extr te J REP (g EA ; (3, x) , (15.28) 

where / REP is the free-energy- density computed by using replicas, q EA is the Edwards- 
Anderson parameter and x is the breakpoint or the size of the blocks in the replica 
matrix. (For simplicity we consider that the inter-state overlap go equals zero [9].) 
Since the integral on the lhs of Eq. (15.28) is dominated by a saddle point contri- 
bution, one finds that, for a given T, fixing the value of x one selects the states with 
a given free-energy-density F. The relationship between / and x reads 

P = (3x = . (15.29) 

Note that within this framework one does not optimize with respect to x. Instead, 
a; is a free parameter and, by changing the value of x, one selects different groups 
of metastable states. Inversely, choosing a value of the free-energy density one 
determines an "effective temperature" T* = T/x. This value coincides, indeed, with 
the dynamic result for T EFF in the aging scale when / = / TH . Otherwise, it gives 
a free-energy level dependent effective temperature. If one pursues the empirical 
relation between this parameter and the dynamic effective temperature this result 
means that when the system evolves in sufficiently long time-scales as to penetrate 
below the threshold it takes different values of T EFF depending on the deepness it 
reached. 

Mezard and Parisi generalised this approach to search for a Kauzmann critical 
temperature (T K = T s ) and characterise the thermodynamic properties of the glassy 
phase below T s in finite d interacting particle systems. The mean-field nature of the 
approach has been stressed by Thalmann [141] who showed that there is no lower 
critical dimension. 
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15.8 Dynamics and quantum systems 

The derivation of the tap equations presented in Section 15.2 can be generalized 
to treat other problems as the real-time dynamics [143] of the same models or their 
quantum extensions [144]. Again, the procedure can be made easy if one correctly 
chooses the perturbative expansion and the order parameters. To study the real- 
time dynamics of the classical problem one is forced to Legendre transform with 
respect to the time- dependent local magnetization, the two-time correlation and 
the response [143]. The presentation is further simplified when one uses the SUSY 
notation introduced in Section 8.2 that renders the dynamic formalism very close 
to the static one. For quantum problems in equilibrium one uses the Matsubara 
representation of the partition function and then Legendre transforms with respect 
to the imaginary-time correlation as well as the local magnetizations [144]. In order 
to derive tap equations for a quantum problem in real-time one should use the 
Schwinger-Keldysh formalism. 

The derivation and study of dynamic tap equations justifies the interpretation 
of the asymptotic non-equilibrium dynamics in terms of the local properties of the 
tap free-energy density landscape. Biroli [143] showed that the dynamics in the tap 
free-energy landscape is in general non-Markovian due to the presence of memory 
terms in the dynamic TAP equations. In the very long-time limit and for random 
initial conditions the contribution of these terms vanishes and one proves that the 
dynamics is a relaxation following flat directions in the tap free-energy landscape 
(the threshold) as proposed in [12, 3]. 

16 Conclusions 

We discussed the behaviour of a family of disordered models that yield a mean-field 
description of the glass transition and dynamics of super-cooled liquids and glasses. 
The relevance of these models to describe structural glasses was signaled and ex- 
plained by Kirkpatrick, Thirumalai and Wolynes in the 80s [11]. Their nonequilib- 
rium dynamics and hence the connection with other systems far from equilibrium 
started to develop more recently [12]. 

In short, their behaviour is the following. The dynamic transition arises when 
the partition function starts being dominated by an exponentially large number of 
metastable states yielding a finite complexity. The static transition instead is due 
to an entropy crisis, i.e. it occurs when the complexity vanishes and the number 
of states is no longer exponential in N, just as in the Adams-Gibbs-di Marzio sce- 
nario [177]. These transitions mimic, in a mean- field way, the crossover to the glassy 
phase at T g and the putative static transition at T Q (or Tk) of fragile glasses, see 
Fig. 2-left [11]. 

The equilibrium dynamics close and above coincides with the one obtained 
with the mode-coupling approach [11]. It describes the relaxation of super-cooled 
liquids and it contains its most distinctive feature of having a two step decorrela- 
tion. The first step is ascribed to the motion of particles within the cages made 
by their neighbours while the second one is the structural relaxation related to the 
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destruction of the cages. 

Below T d the equilibration time diverges with the size of the system and the 
models do not equilibrate any longer with their environments (unless one considers 
times that grow with the size of the system) [12]. This is very similar to the situation 
encountered in real systems below T g . The experimental time- window is restricted 
and one is not able to equilibrate the samples any longer below T g . Aging effects 
as shown in Fig. 7 are captured. The correlations still decay to zero but they do in 
a waiting-time dependent manner. Their decay also occurs in two steps separated 
by a temperature-dependent plateau at a value related to the size of the cages. 
One can interpret their stiffness as increasing with the age of the system given that 
the beginning of the structural relaxation is delayed and slowed down for longer 
waiting-times. 

The nonequilibrium dynamics below approaches a threshold level of flat di- 
rections in phase space and it never goes below this level in finite times with respect 
to the size of the system [12]. The aging dynamics corresponds to the slow drift 
of the point representing the system in the slightly tilted set of channels that form 
the threshold. The motion that is transverse to the channels is related to thermal 
fluctuations and the first stationary step of the relaxation towards g EA , that char- 
caterises then the transverse "size" of the channel. The longitudinal motion along 
the channels is related to the structural relaxation. The tilt is proportional to the 
magnitude of the time-derivatives and these become less and less important as time 
passes. In more generalitiy one interprets the long but finite time nonequilibrium 
dynamics following saddles that are the borders between basins of attraction of more 
stable states in phase space [3]. 

For times that scale with the size of the system, N, the sharp dynamic tran- 
sition is avoided, the system penetrates below the threshold via activation and it 
approaches equilibrium in much longer time-scales. Metastable states below the 
threshold are typically minima [147, 150] (the fact that they are local minima 
can be checked studying the dynamics with initial conditions set to be in one of 
them [157, 139, 18]). This structure allows one to describe the cooling rate effects 
described in Fig. 2-right. For large but finite N and sufficiently slow cooling rate, 
the system penetrates below the threshold via activation when this is facilitated 
by T, i.e. when passing near Tj. To which level it manages to arrive (roughly 
speaking to which of the curves in the figure) depends on how long it stays close to 
Td- The slower the cooling rate the lower level the system reaches with the ideal 
"equilibrium" glass corresponding to an infinitely slow cooling [158]. 

The region of phase space reached asymptotically in the thermodynamic limit is 
the threshold of flat directions. The replica analysis of the partition function gives an 
alternative way of determining its statistical porperties. Indeed, by evaluating the 
partition function on a marginally stable saddle-point in replica space one selects the 
threshold "states". Dynamic information such as the value of q EA is thus obtained 
with a pseudo-static calculation. Other facts as, for instance, the scaling of the 
correlation are not accessible in this way. 

One of the hallmarks of the glassy nonequilibrium dynamics is the modification of 
the relation between correlations and responses, namely, the fluctuation-dissipation 



113 



theorem. In mean-field models for structural glasses one finds that the integrated 
linear response is in linear relation with the associated correlation with a propor- 
tionality constant that takes the equilibrium value l/(ksT) when the correlation is 
above the plateau and it takes a different value l/(ksT*) when it goes below the 
plateau [12]. This behaviour has been found in a number of finite dimensional glassy 
models numerically [58, 53, 54, 55]. 

The behavior just described corresponds to a family of mean-field disordered 
models to which the p spin models with p > 3 and the Potts glass belong. Other 
two families exist and they are related to ferromagnetic domain growth and spin- 
glasses. Two representative models are the spherical p spin model with p = 2 
and the SK model, respectively. They are characterised by different scalings of the 
correlations in the aging regime and by different forms of the modification of fdt. 
The classification in families according to the nonequilibrium behaviour has a static 
counterpart given by the structure of replica symmetry breaking in the low-T phase, 
see Section 15.1. 

The modification of fdt allows one to define an observable and correlation-scale 
dependent effective temperature [112]. Fast observables like the kinetic energy are 
equilibrated with the environment and the effective temperature equals the thermal 
bath temperature for them. Other observables though show different values of the 
effective temperature depending on the time-scales on which one investigates them. 
The effective temperature has a thermodynamical meaning even if defined out of 
equilibrium. In particular, it can be directly read with a thermometer coupled to 
the desired observable and a zero-th law holds for interacting observables that evolve 
in the same time-scale. As one should have expected the effective temperature shares 
some of the qualitative features of the phenomenological Active temperatures [131]. 
For instance, a system that is quenched from high temperatures has effective tem- 
peratures that take higher values than the temperature of the bath, etc. At the 
mean-field level, when N — > oo, it is history independent but one expects it to de- 
pend on the preparation of the sample for finite size and finite dimensional systems. 
(This is in close relation to the discussion above on cooling rate effects.) There is 
still no precise determination of which are the necessary conditions a nonequilibrium 
system has to fulfill to ensure the existence of well-behaved effective temperatures. 
A clear condition are the need to reach a dynamic regime in which the dynamics is 
slow and heat exchanges are weak. 

Once the effective temperature has been identified one interprets the behaviour 
in the low T phase as follows: the system adjusts to a situation in which each 
observable sees two baths, one is the white external one and the one characterising 
the fast motion of the particles, the other is coloured and at a different temperature 
T*. The latter is generated by the interactions. In more complex systems - as mean- 
field spin-glasses - the asymptotic regime might be multithermalised with several 
time-scales each with its own value of the effective temperature. These results, 
first derived explicitly for p spin fully-connected models [112] actually hold for any 
resummation of the pertubative approach that keeps an infinite subset of diagrams 
(the MCA being one such example). The structure of time-scales and values of the 
effective temperature is related to the breaking of supersymmetry down to a residual 
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group [130]. 

The structure of the free-energy landscape can be computed exactly for mean- 
field models in general, and for the spherical p spin model in particular [147, 12, 150, 
149, 171]. We expect its main features to be reproduced - at least in a smoothen 
way - in real glassy systems. The free-energy landscape at fixed and low T has 
a structure as the one roughly sketched in Fig. 21. A pictorial image of the aging 
process can be quite helpful to understand it. Imagine that one fills phase space with 
water whose level reaches a free-energy density value, say, /. At high levels of the 
water, i.e. for high free-energy densities, the landscape has only some few isolated 
stationary states. Looking at the landscape from above one only sees some maxima 
that are represented as islands in the second panel in the figure. Lowering the 
water level the islands grow in size and some of them merge: land bridges develop. 
Lowering still the water level, it eventually reaches a threshold, that corresponds 
to f — / TH , where land percolates. One is left with a labyrinthic path of water as 
drawn schematically in the third panel that represents a top view of the landscape. 
This level is "marginal" since the bottom of the water channels is almost completely 
flat. Draining water from the system the "connectivity" of paths is reduced until 
the water level goes below the threshold, / < / TH , where minima dominate. In 
the fourth panel we represent them as lakes immersed in land. Lowering the water 
level one sees the sizes of the lakes diminish and some of them dry. These minima 
exist until the lowest level, / = / BQ . A "gap" in free-energy density separates the 
threshold and the equilibrium levels. 

This picture allows us to give a natural interpretation of the nonequilibrium 
dynamics following a quench. Initially, the system is in a configuration typical of 
high-T, thus, its initial "free-energy density" is very high. This corresponds to 
a high level of water that fills the landscape. As time passes, water abandons the 
landscape in such a way that the quantity of water progressively diminishes lowering 
its level. The system's configuration can be associated to a ship and its evolution 
to the displacements of the ship sailing on the water. Initially, the water level is 
very high and the ship can move very rapidly far away from its initial position. 
It only sees some very few isolated islands that it simply avoids along its motion 
and the dynamics is very fast. As time passes the water level goes down. Roughly 
speaking we can associate the speed of drainage with the magnitude of the rate 
of change of the energy- density. When it approaches the threshold the available 
path becomes a series of rivers forming a very intricate network. The ship can still 
follow this network without remaining trapped in any confining region. Its motion, 
however, gets slower and slower. In finite times with respect to N the water level 
does not go below the threshold. But for longer times that scale with N it does. 
When such long times are attained the ship remains trapped in lakes. For still 
longer times the higher lakes dry and, if the ship got trapped in one of them it 
must be transported through the land to reach other lakes at lower levels. This 
action represents an activated process. Part of this image was introduced by Sibani 
and Hoffmann phenomenologically [152]. The p spin- models and the like realise it 
explicitly. All quantitative features of the landscape here described with words have 
been, or in principle can be, calculated analytically. The use of this image has been 
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ultimately justified by the dynamic tap approach of Biroli [143]. 

The value taken by the effective temperature is in direct relationship with the 
structure of the free-energy landscape. Indeed, again for p-spin model and the like, 
it has been shown analytically that the asymptotic value T* reached for long but 
finite times with respect to N is given by f3* = 9E(/3, f)/df\f m , with E the com- 
plexity [138]. For even longer times such that the system penetrates below the 
threshold one expects the effective temperature to take different values related to 
the complexity at lower free-energy density levels. The Edwards- Anderson param- 
eter, q EA , also changes since ? E a(/)- in the longest time-scale such that equilibrium 
is reached and q EA equals the equilibrium value also obtained with a replica calcula- 
tion using the standard maximization prescription to determine the breaking point 
parameter x. This result is intimately related to Edwards' flat measure for granular 
matter [134, 33] and also to the more recent use of a flat measure over inherent 
structures [136] to describe the nonequilibrium dynamics of glasses [137, 160, 161]. 
Note that the these, being defined using the potential energy- density landscape, are 
valid only at zero temperature (see, e.g. [142]). However, extensive numerical checks 
recently performed suggest that the approach, even if not obviously correct at finite 
T, yields a very good approximation [137]. 

Within this picture two distinct regimes would appear in the low-T isother- 
mal dynamics of real systems: a mean-field- like one when the system approaches a 
pseudo-threshold of flat directions in phase space and a slower activated regime in 
which the system jumps over barriers to relax its excess energy density and very 
slowly progress towards equilibrium. How and if the aging properties in the first 
and second regime resemble is a very interesting open problem. 

The existence of a threshold plays a fundamental role in explaining several fea- 
tures of many experimental observations in such diverse systems as driven granular 
matter, the rheological properties of complex liquids and glasses, etc. Just to cite 
two examples, trapping and Reynolds dilatancy effects in granular matter [33, 26] 
as well as the existence of a static yield stress and thixotropic behaviour in some 
rheological experiments [19] can be interpreted in terms of threshold and subthresh- 
old states. These features support the claim that this free-energy structure exists 
in real physical systems. Moreover, maybe not surprisingly, this structure also ap- 
pears in optimisation problems such as XOR-SAT and K-SAT that can be mapped 
to dilute p-spin models at zero temperature. In this context the control param- 
eter is the number of requirements over the number variables, a, and the static 
transition, a s , is related to the sat-unsat transition while the dynamic transition, 
ad < a s corresponds to the value where greedy algorithms fail to find the existing 
solutions [153]. 

All these arguments can be adapted to include quantum fluctuations The stat- 
ics is studied with the Matsubara replicated partition function [174], metastability 
with an extension of the tap approach [144] and the real-time dynamics with the 
Schwinger-Keldysh formalism [85, 106]. The picture that arises is very similar to 
the one above with some intriguing new ingredients as the emergence of truly first 
order transitions close to the quantum critical point [176, 174], highly non-trivial 
effects due to the quantum environments [144], a waiting-time dependent quantum- 
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Figure 21: Left: a Id simplified sketch of the free-energy density. Three top views 
of the free-energy landspcape: above, at and below the threshold. 

to-classical crossover in the dynamic scaling, etc. 

The models we studied in these notes have quenched random interactions. Real 
glassy systems of the structural type do not. One may wonder if this is an important 
demciency of the approach or if similar results can be obtained for models with no 
disorder. A large variety of models of mean-field type, or defined on large d spaces, 
with no explicit quenched disorder and having the same phenomenology have been 
introduced in recent years [166, 140]. Finite d models with similar, eventually inter- 
rupted, dynamic behaviour have also been exhibited [55, ?, 53, 54]. Their existence 
supports the belief that the scenario here summarized goes beyond simple modelling. 
Indeed, it is at the basis of several conjectures for the behaviour of other nonequi- 
librium systems with slow dynamics that have been later checked numerically. It 
has also motivated several experimental investigations in a variety of systems. 

17 Perspectives 

We would like to end these notes by mentioning some of the directions for future 
development in this area. Within the "mean-field" approach there remain at least 
two important open technical problems to complete their analytic solution: 

Matching. Having approximated the dynamic equations as explained in the text we 
are not able to determine the complete scaling form of correlations and responses. 
In models like the p spin spherical we cannot fix the scaling function h(t). Going 
beyond the asymptotic solution requires to solve the matching of the solution at 
short time-differences with the one at long time-differences. This is a very tough 
mathematical problem. 

Dynamics at infinite time-scales. In order to penetrate below the threshold in p 
spin spherical models and approach equilibrium one has to consider times that grow 
with A" and include instanton solutions to describe the activated dynamics below T^. 
This will smoothen the dynamic transition and convert it into a crossover. It will 
also possibly allow the mode-coupling and similar approaches to yield more accurate 
quantitative predictions. 

Even though the models we discussed are mean-field we believe that the general 
picture developed holds beyond this limit. Some numerical and experimental tests 
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support this belief. Still, one would like to justify this claim theoretically. Some of 
the lines of research that are now being followed with this aim are: 

Dynamics of dilute disordered models. These are disordered spin models on random 
graphs. Even if still mean-field they include some spatial fluctuations that one can 
study numerically and analytically [88, 154]. Moreover, their relation to optimisation 
problems make them interesting per se. 

Dynamic heterogeneities. Supposedly these are nanoscale regions in supercooled 
liquids and glasses that are very important in determining the glass transition and 
the dynamics. They have been studied numerically and experimentally so far and 
one would like to have a theoretical model including and describing them. A step in 
this direction was followed in [84] where a sigma-model-like description for the spin- 
glass problem was introduced. This lead to proposing that the distribution of the 
coarse-grained local correlations and responses should be constrained to follow the 
global relation x(C)> this proposal was checked numerically in [117] for the 3cfeA and 
studies on other disordered models are underway. The study of these distributions 
in real glasses as well as the development of a complete analytical description are 
problems that deserve further study. 

Dynamic functional renormalisation group (fkg). It would be very interesting to 
extend the frg to attack nonequilibrium situations with aging dynamics. 

FD relations for finite d systems. Many questions about the form of the relations 
between global responses and correlations in real systems can be raised. Do all 
systems undergoing domain growth in d > 1 have two-time scales with the slower 
one characterised by T* — > oo? Can a situation as the one found for the SK model 
be realised, i.e. does any real system have an effective temperature with more than 
two values (T and T*)? 

Relations between statics and dynamics. A link between the nonequilibrium FD 
relations and Parisi's P{q) was found in some mean-field models (note that it does 
not hold for models with a threshold as the p spin) . It was then argued that it should 
hold in finite d systems under certain assumptions [155]. The long-lasting debate 
about the nature of the spin-glass phase has now been rephrased in nonequilibrium 
terms, the question now being what is the form of the asymptotic x(C) plot. Recents 
experiments address this problem [32]. Analytical results for finite d models are yet 
not available. 

Thermodynamics and statistical mechanics out of equilibrium. From a more generic 
viewpoint, the development of a thermodynamics and statistical mechanics for mod- 
els that evolve slowly out of equilibrium is a very important issue. Some progress in 
both directions has been made recently. One should try to establish these proposals 
in a less phenomenological way. 

All these problems are challenging and very interesting. Many more could be 
added to this short list. We can expect to see progress in this very active area of 
research in the near future. 



118 



A Generalized Langevin equations 

In this Appendix we derive a generalized Langevin equation starting from time- 
reversal microscopic equations for the motion of the system and the constituents 
of the bath. We use the simplest image of a thermal bath that is given by an 
ensemble of harmonic oscillators with masses m a and frequencies u> a , a = 1, . . . , N 
and, for simplicity, we consider a system made of a single particle with mass M. 
We consider the one-dimensional case to simplify the notation. The generalization 
to more complex systems and/or to more complicated baths and higher dimensions 
is straightforward [156]. We call q,p and x a ,p a , a = 1,...,N the positions and 
momenta of the particle and oscillators, respectively. The Hamiltonian of the total 
system is of the form (4.1), 

„2 i N 2 N 2 i N N 

Z1V1 z a=l '"« W o a=l Z '"' a Z a=l a=l 

All these terms have been discussed in Section 4.1.1. Hamilton's equations for the 
particle are 

while the dynamic equations for each member of the environment read 

x a (t) = ^— , p a (t) = -m a u 2 a x a (t) + c a q(t) , (A.2) 

showing that they are all forced massive harmonic oscillators. These equations are 
readily solved yielding 

x a (t) = x a (0) cos{u a t) + E™21. sfn(cca) + /* dt' sin(uj a (t - t'))q(t') (A.3) 

m a uj a m a uj a Jo 

with x a (0) and p a (0) the initial coordinate and position at time t — when the 
particle has been set in contact with the bath. The replacement of this expression 
in the last term on the RHS of Eq. (A.l), implies 

dV(a) /■* N c 2 

P^^-TlW+vit)- / dfT^-O^O-E-^ 008 ^-*)?^), (A.4) 
oq[t) Jo ^ m a uj l a 

with the kernel 7 given by 

N 2 

7(* - = E C0S Mt - 0) , (A.5) 

and the time- dependent force r\ given by 

N c N 
r)(t) = — —Pa(0) sin(uj a t) + E c a x a (0) cos(u a t) . (A. 6) 
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Usually, the environments are made of ensembles of equilibrated entities at a chosen 
temperature T. Then, (p a (0), x a (0)} are initially distributed according to 



exp(-[3H ENV [{p a (0),x a (0)}}) 
fI\Lidp a (0)dx a (0) exp{-(3H ENV [{p a {0),x a {0)}]) 



P({ Pa (0),X a (0)}) = r N ^TZL/r "T- orr ) r _L 7^ ' ^ 



It is convenient to assume that equilibrium distribution is shifted with respect to 
the coupling to the particle at the initial time; this allows one to eliminate the last 
term in Eq. (A. 4). As when including the counter-term, we choose 



H E nv — y ' 



m n u)l 



x a 




(A.8) 



Defining a new noise £(£) — rj(t) — J2 a =i m°i 2 cos(u a t)q(0), it is a Gaussian random 
variable with 

(f(t)) = for all times, (A.9) 

mm) = ksT^t-f) (a.io) 

and the Langevin equation simplifies to 

Pit) = + m - J* dt> 7 (f - t')q(t') . (A.ll) 

A random force with non-vanishing correlations on a finite support is usually called 

a colored noise. 

Interestingly enough, "f(t — t') and the noise- noise correlation are proportional, 
with a constant of proportionality of value ksT. This is a generalized form of the 
fluctuation-dissipation relation, and it applies to the environment. In this derivation 
it is clear that it is a consequence of having assumed the equilibration of the bath. 

The third term on the RHS of Eq. (A.ll) represents a rather complicated friction 
force. Its value at time t depends explicitly on the history of the particle at times 
< t' < t. The memory kernel / ~f(t — t') plays the role of a retarded friction function. 
This term makes Eq. (A.ll) non-Markovian. 

Different choices of the environment are possible by selecting different ensembles 
of harmonic oscillators. The simplest choice, that leads to an approximate Marko- 
vian equation, is to consider identical oscillators coupled to the particle via the 
coupling constants ic/v^/V but having a non-trivial distribution of frequencies, that 
in the limit — > oo, can be treated as continuous. This allows one to introduce the 
spectral density I(u>) and rewrite the kernel 7 as 

a c 2 f°° , t / n cos(cu(t - 1')) .. 

7 it -t') = — du — y —±= ^ . A.12 

m Jo u 2 

For a Debye distribution of frequencies 

-r, x 3w 2 „. . , / ,x 3c 2 sin( uj D (t — t')) .. 

Uu) = -^OiuoD - uo) one has 7 (t - t') = =- — . A.13 

V 1 uo% V u 1 ,v > mLU 2 D uo D (t-t') V 1 
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If uid is sufficiently large, 7 can be approximated by a delta function, j(t — t') = 
2^5{t — t') with 7 = 3c 2 7r/(2ma;| ) ), and Eq. (A. 4) becomes Markovian. 

Different environments are characterized by different choices of the spectral den- 
sity I(<jS) at small u. For example, one has an Ohmic (s = 1), sub-Ohmic (s < 1) 
or super-Ohmic (s > 1) bath if I{uj) ~ uj s for uj ~ 0. 



B The Kubo formula 



The Kubo formula relates the linear response to the asymmetric correlation of a 
quantum process. It holds at the level if the linear response even of the system is 
out of equilibrium. The linear response reads 



RAB(t, t ) 
1 



Sh B (t') 
SZ(h B ) 



\—Tr(u t (h B )A(0)U t -\h B )p(0)) 



Z(h B ) 



h B =0 



Z\h B ) 5h B {t>) 



Tr 



U t (h B )A(0)U t -\h B )p(0) 



1 



Z(0) 



Tr 



h B =0 

1, 



5h, 



5h f 



where Ut{h B ) is the evolution operator, Ut{h B ) exp[i/HH8] for all infinitesimal time 
intervals except from the one going from t' — 5/2 to t' + 5/2 where it takes the form 
U t (h B ) exp[i/h(H — h B B)}. See the left-panel in Fig. 8 for a graphical representation 
of a kick-like perturbation, t > t' . Calculating the variations explicitly, and using 
(A(t)) = or (A(t)), we have 



R.AB{t, t') 



Z(0) 



Tr 



% - (-B(t')U t (0)A(0)Ui\0) + U t (0)A(0)B(t')U t ~\0)) p 



= j.{[A(t),B(t>)}). 



h B =0 

(B.1) 



C The response in a Langevin process 

By the definition the linear response is given by 



5h(t') 



h=0 



5h(t') 



VqViqVtpV^j q(t) exp (-S EFF + J dt" iq(t")h{t"\ 



h=0 



with ^eff defined in Eq. (8.6) and evaluated at vanishing sources. The RHS imme- 
diately leads to R(t,f) = (q(t)iq(t)), i.e. Eq. (8.7). 

The proof of the relation (8.8) is slightly more involved. The correlation between 
coordinate and noise can be obtained from the variation with respect to X(t,t') of 
the generating functional (8.3) once the identities (8.4) and (8.5) have been used 
and the source 

J dfdti" X(t",t"')q(t")C(t"') (C.l) 
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has been added. Integrating over the noise and keeping only the linear terms in A 
in the effective action since all others will vanish when setting A = 

kgT f 

Linear terms = - J dtidt 2 dt 3 dt 4 [A(ti, t 2 )q(ti)^(t 2 , t 3 )iq(t4)5(t4 — t 3 ) 

- t 2 )-y(t 2 , t 3 )X(U, t 3 )q(h)\ . (C.2) 

The variation with respect to A(f , t') yields (k B T) /2 / dt" [y(t', t") + 7^" , f )] (q(t)iq(t")) 



D Grassmann variables and supersymmetry 

Grassmann variables anticommute 9 2 = 9 = [0,0]+ = 0. The integration rules are 
J d0 = J d9 = and J d99 = J d0 — 1 while the derivation is such that <% = J d0 
and <% = J d9. 

In the supersymmetric formalism used in Section 8 one enlarges the usual "bosonic" 
space to include two conjugate Grassmann variables and 0: t — > a — (t,9,9). A 
"superfield" and its "supercorrelator" are then defined as 

$(a) = q(t)+i>(t)0 + 4;(t)0 + iq(t)00 , Q(a, b) = <$(a)$(6)> , (D.l) 

b = (t',9,9'). The latter encodes the usual correlations {q(t)q(t')), (q(t)iq(t')) , 
{iq(t)q(t')), (iq(t)iq(t')} , as well as "fermionic" correlators (q(t)ip(t')), (ip(t)iq(t')) , 
{ip(t)ip(t f )) , etc. The solutions we construct and study are such that all correlators 
that involve only one fermionic variable ■?/> and ^ vanish. We are then left with 
the usual four correlators purely bosonic correlators and the fermion bilinears. One 
proves that the latter equal the linear response. If, moreover, we only consider causal 
solutions, Q(t,t') = (iq(t)iq(t')) = and 

Q(a, b) = C(t, t') - (9' - 9) (0'R(t, t') - 0R(t', t)) . (D.2) 

Convolutions, or operational products, and Hadamard, or simple products, are de- 
fined as 

Qi(a,&)<g>Q 2 (&,c) = J dbQ 1 (a,b)Q 2 (b : c) , 
Qi(a,b)*Q 2 (a,b) = Qi(a,b)Q 2 (a,b) , (D.3) 

respectively, with db = dtd9d9. 

For correlators of the causal form (D.2), the convolution and the Hadamard 
product respect the structure of the correlator. Indeed, the result of the convolution 
is again of the form (D.2) with 

C C0NV (t, t") = J dt 1 t')R 2 (t", t') + R 1 (t, t')C 2 (t', t")] , 

#conv(*, t") = J dt 1 R 1 (t, t')R 2 (t', t") , (D.4) 
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and the result of the Hadamard product is also of the form (D.2) with 

Chad(m') = Ci(*,oc 2 (*,0> 

The Dirac delta function is defined as 6 (a -b) = S(t - t')(9 - 9)(9 - 6'). 

E Integrals in the aging regime 

Integrals of the form 

hit) = /* dt"A(t,t")B(t,t") (E.l) 
Jo 

appear, for example, in the equation for n(t). We separate the integration time- 
interval as in Eq. (12.8). If 5 is chosen to be a finite time, A(t,t") and B(t,t") in 
the first interval can be approximated by A(t, 0) that vanishes when t — > oo. Since 
the integration interval is finite, this term can be neglected. In the second interval 
the functions vary in the aging regime and in the third interval they vary in the 
stationary regime. Thus 

h{t) ~ / ' dt"A AG (t,t")B AG (t,t") + f dt" \(A ST (t-t")+ lim lim A(t,t") 

J 5 J A t LV t— t"— ►oo t"^oo 



x(B ST (t-t")+ lim lim B(t,t")) 

\ t—t"^oo t"— >oo / 



We assume that this separation is sharp and that we can neglect the corrections 
associated to mixing of the three regimes. In the third term we replaced A and B in 
terms of A ST , B ST . We can now replace the lower limit of the first integral by and 
its upper limit by t. In addition, assuming that B is proportional to the response, 

lim lim 5(M") = 0, (E.2) 

t—t"^oo t"-*oo 

and that A is a function of the correlation such that 

lim lim A(t, t") = A qEA (E.3) 

t—t"—*oo f— >oo 

we have 

ft fOO roo 

h(t) ~ dt"A AG (t,t")B AG (t,t")+A qEA dr'B ST (r')+ dr' A st (t')B st (t>) 
Jo Jo Jo 

where the upper limit tending to infinity is t — A t — > oo. 

Another type of integrals is: I 2 (t,t') = //, dt"A(t,t")B(t",t'). In particular, if 
B — 1, A(t,t") = R(t,t"), t' — and t — > oo, this integrals yields the static 
susceptibility. If instead, t' is long and t too we have the type of integral appearing 
in the equation for the response. Let us assume that t and t' are far apart; we start 
by dividing the time interval in three subintervals 

/'=/ a " + / A ' + /' (E.4) 

Jt' Jt> J A., J A t 



123 



and by approximating the functions A and B assuming that they have a two-step 
decay as the one in Sections 11.1 and 11.2: 



hit, t') ~ / A " dt"A AG (t, t")B(t" - t') + r dt"A AG (t, t")B AG (t", 

Jt' JA t , 

+ /* dt"A(t-t")B AG (t",t') . (E.5) 

In the first term B(t — t") can be replaced by B(t — t") = lim^"-^ linty/-^ B(t, t") 
+B ST (t — t"). The same applies to A in the last term. All functions vary fast in the 
stationary regime but very slowly in the aging regime. The next assumption is that 
functions in the aging regime that are convoluted with functions in the stationary 
regime, can be considered to be constant and taken out of the integrals. That is to 
say 

I 2 (t,t') ~ A AG (t,t') f At ' dt"B(t"-t')+ f At dt"A AC Xt,t")B AC Xt",t') 

Jt' JA t , 

+B AG (t,t') f dt"A(t-t") 

JA t 

~ A AG (t,t') dr'B(r')+ dt"A AG (t,t")B AG (t",t') 
Jo Jf 

[CO 

+B AG (t,t') / dr'A(r') , (E.6) 
Jo 

where we used t — A t — > oo and A t > — t' — > oo. When this integral appears in the 
equation for the response, A{t') and B{r') are proportional to the response function 
since one is the response itself and the other is the self-energy. Using fdt the 
integrals in the first and third term can be computed in the classical limit or they 
can be expressed as functions of the correlation in the quantum case. The second 
term instead depends exclusively on the aging dynamic sector. 

All other integrals can be evaluated, in the large-time limit, in a similar way. 
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